-- Logs begin at Tue 2022-08-23 21:18:48 UTC, end at Tue 2022-08-23 22:47:56 UTC. -- Aug 23 22:06:43.880099 dv-cinder-842542-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 22:06:43.890127 dv-cinder-842542-4-smb devstack@keystone.service[81699]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:06:43 2022] *** Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: nodename: dv-cinder-842542-4-smb Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: machine: x86_64 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: clock source: unix Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: pcre jit disabled Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: detected number of CPU cores: 4 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: current working directory: / Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: your processes number limit is 47680 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: your memory page size is 4096 bytes Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: detected max file descriptor number: 2048 Aug 23 22:06:43.892165 dv-cinder-842542-4-smb devstack@keystone.service[81699]: lock engine: pthread robust mutexes Aug 23 22:06:43.893596 dv-cinder-842542-4-smb devstack@keystone.service[81699]: thunder lock: enabled Aug 23 22:06:43.893596 dv-cinder-842542-4-smb devstack@keystone.service[81699]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 22:06:43.893596 dv-cinder-842542-4-smb devstack@keystone.service[81699]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:06:43.936612 dv-cinder-842542-4-smb devstack@keystone.service[81699]: Python main interpreter initialized at 0x55662c3c79c0 Aug 23 22:06:43.936612 dv-cinder-842542-4-smb devstack@keystone.service[81699]: python threads support enabled Aug 23 22:06:43.936612 dv-cinder-842542-4-smb devstack@keystone.service[81699]: your server socket listen backlog is limited to 100 connections Aug 23 22:06:43.936612 dv-cinder-842542-4-smb devstack@keystone.service[81699]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:06:43.937075 dv-cinder-842542-4-smb devstack@keystone.service[81699]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:06:43.937075 dv-cinder-842542-4-smb devstack@keystone.service[81699]: *** Operational MODE: preforking *** Aug 23 22:06:43.937373 dv-cinder-842542-4-smb devstack@keystone.service[81699]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:06:43.937373 dv-cinder-842542-4-smb devstack@keystone.service[81699]: spawned uWSGI master process (pid: 81699) Aug 23 22:06:43.937643 dv-cinder-842542-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 22:06:43.938690 dv-cinder-842542-4-smb devstack@keystone.service[81699]: spawned uWSGI worker 1 (pid: 81714, cores: 1) Aug 23 22:06:43.938690 dv-cinder-842542-4-smb devstack@keystone.service[81699]: spawned uWSGI worker 2 (pid: 81715, cores: 1) Aug 23 22:06:43.938690 dv-cinder-842542-4-smb devstack@keystone.service[81699]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:06:48.379890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:48.379890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: from cryptography.utils import int_from_bytes Aug 23 22:06:48.381188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:48.381188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: from cryptography.utils import int_from_bytes Aug 23 22:06:48.433985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:06:48.434267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:06:48.434594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] command line args: [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:06:48.434972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:06:48.435204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ================================================================================ {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:06:48.435524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] admin_token = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.435829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] config_dir = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.436071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.436311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] config_source = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.436547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] debug = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.436831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.437500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.437679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.438102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.438523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.438933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.439245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_config_append = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.439558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.439860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_dir = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.440184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_file = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.440631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.441038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.441411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.441801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.442119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.442404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.442807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.443705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.444042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.444394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.444751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.445123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.445491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.445861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.446254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.446850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.447108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] publish_errors = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.447399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.447704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.447943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.448250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.448545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.448867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] standard_threads = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.449192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.449497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.449728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.449962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] use_journal = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.450215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] use_json = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.450454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] use_stderr = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.450697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] use_syslog = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.450992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:48.451314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.451627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.451972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.452275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.452586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.452921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.453235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.453540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.453848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.454157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.454471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.454774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.455085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.455380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.455941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.456250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.456550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.456908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.457229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.457539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.457832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.458177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.459089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.459411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.459722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.460025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.460342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.460635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.460975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.461290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.461601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.461895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.462185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.462494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.462802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.463107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.463421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.463714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.464019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.464316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.464604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.464948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.465247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.465544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.465847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.466167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.466467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.466771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.467067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.467368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.467668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.467980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.468285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.468590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.468933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.469237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.469534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.469832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.470120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.470467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.470759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.471062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.471354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.471676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.471974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.472271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.472572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.472914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.473254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.473563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.473878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.474824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.475062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.475364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.475662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.475973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.476274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.476579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.476931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.477242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.477538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.477835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.478208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.478543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.478910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.479244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.479633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.479965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.480307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.480662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.481027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.481402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.481736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.482066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.482388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.482714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.483038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.483442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.483783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.484130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.484465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.484844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.485189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.485547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.485874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.external = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.486195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.486584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.486909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.487231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.password = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.487555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] auth.token = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.487893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.488218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.488554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.488912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.489262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.489638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.489973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.490301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.490667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.491013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.491353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.491682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.492025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.492411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.492755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.493124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.493465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.493815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.494201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.494539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.494897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.495230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.495579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.495905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.496287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.496624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.497001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.497323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.497663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.498003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.498348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.498679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.499024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.499353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.499690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.500023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.500364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.500724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.501064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.501347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.501638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.501916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.502200 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.502513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.502821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.503101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.503386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.503665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.503956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.504251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.504562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.504922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.505339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.505707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.506013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.506314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.506630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.506934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.507228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.507526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.507829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.508129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.508443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.509043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.509233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.509576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.509980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.510462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.510797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.511148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.511524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.511877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.512220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.512582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.513140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.513481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.513828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.514198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.514579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.514946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.515289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.515658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.515986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.516307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.516607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.516957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.517257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.517562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.517884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.518177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.518500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.518816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.519124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.519418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.519714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.520013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.520315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.520618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.521539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.521833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.522146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.522459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.522770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.523082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.523390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.523709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.524012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.524316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.524617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.524967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.525286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.525601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.525903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.526227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.526530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.526840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.527145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.527445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.527758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.528071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.528379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.528678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.529016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.529326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.529643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.529960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.530266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.530583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.530907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.531205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.531516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.531845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.532161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.532457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] role.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.532763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] role.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.533087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.533410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.533724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.534034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.534344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.534654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.534965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.535276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.535655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.535963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.536286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.537188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.537487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.537802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.538300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.538596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.538914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.539228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.539541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.539861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.540163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.540482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.540853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.541246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.541628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.542031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.542359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.542731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.543103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.543494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.543853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.544199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.544542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.544937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.545290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.545643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.546001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.546379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.546737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.547085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.547443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.547799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.548163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.548520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.548903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.549255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.549616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.549974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.550333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.550748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.551145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.551501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.connection = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.551857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.552357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.552739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.553114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.553386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.553693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.553994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.554297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.554612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.554917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.555220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.555518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.555840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.556142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.556447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.556741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.557082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.557385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:48.557604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:06:48.589210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.589436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.589658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.598286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.628302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.628517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.685158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.736255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.736517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.897065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.897305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.897516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.897722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.897940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.898156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.923529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.923744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.923954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.924177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.924396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.924610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.924851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.937289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.951497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.951714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.951926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.952146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.952360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.952571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.952783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81715) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:48.971206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.971426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:48.971736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.971934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:48.972209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.972474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.973055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.973321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.983329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.983609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.983885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.984174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.991742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:48.994678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:48.994964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.995247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.995530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.995815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.996084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.996367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.996629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.997044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.997324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:48.997595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.020236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.021877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.022218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.026996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.027280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.027567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.033948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.034245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.038920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.039213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.039498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.039781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.040056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.040331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.040603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.040893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.059173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.059471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.063363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.066601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.066898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.071194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.074436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.077782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.078135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.078473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.078834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.079182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.079527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.095923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.096236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.096506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.096768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.104823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.106399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.106671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.109341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.109629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.109920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.110212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.110502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.122631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.122931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.123219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.123503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.123787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.124066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.124344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.140092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.143203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.146806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.148368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.150049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.150404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.150763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.157721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.159355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.163152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.163495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.163843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.164175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.173506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.173805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.174097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.181542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81715) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:49.181832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.182113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.182387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.182668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.182951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.183222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.183489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.183769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.184046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.184325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.184597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.184897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.185156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81715) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:49.220596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55662c3c79c0 pid: 81715 (default app) Aug 23 22:06:49.224764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab70d8-3954-4b83-a52d-3455eca5e7c6 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:49.225072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab70d8-3954-4b83-a52d-3455eca5e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:49.225337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab70d8-3954-4b83-a52d-3455eca5e7c6 None None] PATH_INFO: `/v3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:49.229735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Tue Aug 23 22:06:49 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:49.848399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:49.848399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: from cryptography.utils import int_from_bytes Aug 23 22:06:49.849931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:49.849931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: from cryptography.utils import int_from_bytes Aug 23 22:06:49.898101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:06:49.898342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:06:49.898596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] command line args: [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:06:49.898936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:06:49.899175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ================================================================================ {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:06:49.899499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] admin_token = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.899826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] config_dir = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.900074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.900320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] config_source = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.900562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] debug = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.900862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.901182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.901430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.901753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.902074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.902376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.902648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_config_append = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.902902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.903148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_dir = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.903394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_file = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.903704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.904025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.904346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.904669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.904948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.905191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.905522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.905849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.906149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.906453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.906784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.907089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.907409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.907725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.908074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.908656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.908927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] publish_errors = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.909232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.909524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.909760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.910075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.910374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.910671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] standard_threads = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.911008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.911330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.912361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.912603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] use_journal = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.912976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] use_json = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.913097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] use_stderr = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.913328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] use_syslog = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.913639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:49.913969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.914277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.914612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.914922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.915243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.915553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.915880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.916187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.916506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.916887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.917220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.917524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.917843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.918159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.918479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.918797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.919103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.919430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.919755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.920080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.920385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.920708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.921077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.921406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.921726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.922031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.922333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.922638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.922948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.923273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.923593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.923894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.924205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.924524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.924867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.925189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.925507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.925805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.926110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.926415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.926711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.927059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.927972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.928774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.928774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.928774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.929324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.929324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.929654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.929832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.930053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.930353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.930632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.930918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.931201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.931486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.931768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.932053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.932333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.932635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.932951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.933236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.933510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.933811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.934089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.934359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.934638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.934928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.935238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.935522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.935812 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.936100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.936376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.936660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.936988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.937289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.937577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.937862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.938152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.938437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.938718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.938998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.939278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.939559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.939869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.940152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.940451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.940736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.941054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.941325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.941601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.941977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.942203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.942442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.942761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.943617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.943811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.944168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.944383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.944679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.944998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.945300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.945609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.945893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.946165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.external = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.946439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.946782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.947081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.947358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.password = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.947637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] auth.token = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.947919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.948200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.948495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.948765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.949100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.949388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.949662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.949941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.950274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.950794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.950794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.951140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.951412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.951692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.951998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.952303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.952586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.952930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.953262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.953548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.953892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.954180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.954478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.954755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.955036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.955322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.955860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.956128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.956415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.956689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.957014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.957331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.957630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.957913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.958209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.958743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.959152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.959458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.959742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.960019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.960311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.960588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.960911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.961207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.961531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.961807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.962078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.962350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.962631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.962919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.963203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.963500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.963783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.964090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.964370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.964647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.964956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.965243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.965521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.965801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.966086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.966371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.966669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.966937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.967256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.967553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.967831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.968124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.968417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.968690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.969002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.969289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.969570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.969847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.970137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.970418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.970693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.970983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.971281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.971529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.971800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.972091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.972379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.972654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.972984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.973271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.973543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.973990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.974439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.974738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.975029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.975325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.975614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.975889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.976162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.976475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.976753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.977075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.977379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.977687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.977983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.978277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.978572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.978866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.979179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.979472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.979771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.980054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.980337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.980620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.980949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.981246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.981532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.981828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.982101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.982388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.982666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.982941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.983219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.983507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.983788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.984061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.984335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.984613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.984944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.985239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.985526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.985820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.986113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.986391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.986676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.986952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.987259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.987570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] role.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.987862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] role.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.988169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.988434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.988737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.989094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.989393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.990211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.990508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.991003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.991326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.991612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.991910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.992203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.992498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.992792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.993332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.993612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.993904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.994193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.994490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.994778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.995044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.995360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.995665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.995946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.996217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.996491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.996759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.997098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.997403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.997719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.998003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.998290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.998567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.998849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.999131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.999422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:49.999700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.000001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.000293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.000575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.000903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.001191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.001478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.001756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.002030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.002313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.002599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.002886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.003155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.003439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.003781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.004089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.connection = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.004374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.004661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.004994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.005341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.006112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.006394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.006672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.006971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.007257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.007582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.007877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.008157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.008452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.008735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.009067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.009338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.009619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.009892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:50.010082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81714) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:06:50.038502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.038845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.039162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.048097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.077437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.077830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.115944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.152700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.152981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.195255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.195499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.195701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.195922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.196145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.196358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.210449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.210744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.211034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.211321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.211618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.211902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.212186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.221906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.317192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.317528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.317870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.318178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.318501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.318809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.319112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81714) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:50.335254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.335540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:50.336053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.336383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:50.336860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.337282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.337732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.338107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.347893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.348179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.348455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.348746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.356564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.359774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.360063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.360380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.360664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.360971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.361246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.361514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.361791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.362072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.362363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.362660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.386648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.388252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.388636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.394438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.394861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.395270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.402437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.402807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.406983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.407343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.407702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.408049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.408391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.408742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.409106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.409437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.426928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.427944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.432172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.435457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.435754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.440083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.443304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.446558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.446894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.447188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.447476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.447755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.448069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.464424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.464753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.465018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.465281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.472082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.473646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.474465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.478694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.478988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.479285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.479571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.479850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.492012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.492303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.492589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.492897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.493184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.493463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.493748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.509625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.512556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.515532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.517211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.518761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.519113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.519401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.526683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.528289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.531294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.531587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.531875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.532158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.540959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.541365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.541761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.548904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81714) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:50.549284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.549650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.550021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.550385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.550754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.551176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.551582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.552076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.553113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.553532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.553936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.554303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.554656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81714) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:50.589652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55662c3c79c0 pid: 81714 (default app) Aug 23 22:06:56.292187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.292734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.293002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.294904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:56.305347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.305900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.305900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.381273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: INFO dbcounter [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] Registered counter for database keystone Aug 23 22:06:56.402166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG oslo_db.sqlalchemy.engines [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81714) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:06:56.409049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writer thread running {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:06:56.612317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG passlib.handlers.bcrypt [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81714) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:06:56.612929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG passlib.handlers.bcrypt [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81714) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:06:56.673092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:56.674801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:56.845389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1/3] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:06:57.401796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:57.472673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: INFO dbcounter [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] Registered counter for database keystone Aug 23 22:06:57.497425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG oslo_db.sqlalchemy.engines [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:06:57.504645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writer thread running {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:06:57.631362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047ec03-32be-413b-857e-651eaa3ae9fd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:57.636001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:57.636658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:57.636976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:57.637247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:57.647985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:57.699769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:06:57.700028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb30b40-bd2f-48b7-9315-dd35843adb9f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:57.711668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 3/4] 10.222.0.69 () {58 vars in 1324 bytes} [Tue Aug 23 22:06:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:06:57.718148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:57.736661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca7b59-a49b-4095-b0f8-972f4e0ee84c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:57.742816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:57.744642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:57.744976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:57.745259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] PATH_INFO: `/v3/projects/c27876b25e104fc48bd2eb1b5131a55c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:57.746828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] RBAC: Authorizing `identity:get_project(project_id=c27876b25e104fc48bd2eb1b5131a55c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:57.809522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:06:57.809872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccafa5-d984-44cb-b2bb-ff8d60b60a7e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:57.814599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 2/5] 10.222.0.69 () {56 vars in 1207 bytes} [Tue Aug 23 22:06:57 2022] GET /identity/v3/projects/c27876b25e104fc48bd2eb1b5131a55c => generated 344 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:59.860027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1273-51b0-4788-a602-14e4a05c9c20 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.860622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1273-51b0-4788-a602-14e4a05c9c20 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.860622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f1273-51b0-4788-a602-14e4a05c9c20 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.864953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 4/6] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:06:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:59.871210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.871806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.871806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.892613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:59.895064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:59.903546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 3/7] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:07:00.188135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f1273-51b0-4788-a602-14e4a05c9c20 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.201184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f1273-51b0-4788-a602-14e4a05c9c20 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.205877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.206505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.206785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.207061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.216422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.218264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e5c4-4e4a-49c6-bd63-9b9b22e3e8f3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.229017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 5/8] 10.222.0.69 () {58 vars in 1324 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:07:00.235828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.253224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468594d7-46f8-4e1c-810f-63c375225e7a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.260843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.261892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.262353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.262809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.265123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.268387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9dc26-1f5e-49cb-8c60-7000a04e2802 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.271774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 4/9] 10.222.0.69 () {56 vars in 1198 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:02.388766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff07be-e0dd-43f2-8c10-8909fdc475b0 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.389584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff07be-e0dd-43f2-8c10-8909fdc475b0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.389584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff07be-e0dd-43f2-8c10-8909fdc475b0 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.390766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:02.397745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19f29-b2ed-4822-85af-bfcd0d2a22a7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.398261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19f29-b2ed-4822-85af-bfcd0d2a22a7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.398688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19f29-b2ed-4822-85af-bfcd0d2a22a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.429199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-70d19f29-b2ed-4822-85af-bfcd0d2a22a7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.431177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-70d19f29-b2ed-4822-85af-bfcd0d2a22a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.575271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 5/11] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.607765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8d07-c94a-4a1f-b6fb-90d39ba84e55 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.608208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8d07-c94a-4a1f-b6fb-90d39ba84e55 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.608589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8d07-c94a-4a1f-b6fb-90d39ba84e55 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.610102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 7/12] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:02.616367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.616654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.616973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.643818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.645376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.667759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.757835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 6/13] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.857433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce8d07-c94a-4a1f-b6fb-90d39ba84e55 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.035785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.114478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce8d07-c94a-4a1f-b6fb-90d39ba84e55 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.158658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.160021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.160408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.161442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.175841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42c87a-ba37-4125-936d-b13212481b25 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.181264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:03.197455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:03.199345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:03.201007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 8/14] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:03.206200 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.227994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.228828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.229224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.229597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.254004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.262488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.338113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.339537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.358569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518977c-2b95-4c26-ab25-613699cf5e9c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.410649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.411893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.412246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.412637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.413518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.413933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.415762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.444046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 9/15] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:03.445723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.471115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 7/16] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:03.478905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.548018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.571204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.579464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a841891-ba99-493b-b943-2602a7b22fad None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.608027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe20382-6a26-49be-bec7-435b522041d2 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.626074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.626866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.627234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.627600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.630328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.631985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.633960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 10/17] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.640324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.651804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.652688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.653104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.653380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.666895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.668382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:03.690109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:03.691693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:03.694589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:03.694589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:03.694589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:03.694589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 8/18] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:03.698533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.767641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cf7b2-1ef7-4c4c-917d-366e2786d2d1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.812996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.813807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.814252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.814700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.816670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.819891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.822639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 11/19] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:03.828876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.836422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c899c4d-eba5-4e62-948d-a795d548a852 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.839006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.869923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.877545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.878295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.878701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.879101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.880523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.881281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.883040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e88ec-6a0d-4181-b451-e0d51fc95ec0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.904584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 9/20] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:03.950848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928ea7-80ca-45e5-b9b8-94f47f942f6c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.996993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.997851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.998229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.998599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.999459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.domain.id=default, user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.999861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.001614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb2b89-0bc3-4cd8-adb5-1507d9471787 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.012698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 12/21] 10.222.0.69 () {56 vars in 1322 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/role_assignments?user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191&scope.domain.id=default&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 233 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:07.023116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e1e-073f-4fd1-9f05-99edbfefc06b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.023671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e1e-073f-4fd1-9f05-99edbfefc06b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.023671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd93e1e-073f-4fd1-9f05-99edbfefc06b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.025025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 10/22] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:07.043770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.045272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.046061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.083967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG passlib.handlers.bcrypt [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81715) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:07:07.085150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG passlib.handlers.bcrypt [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81715) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:07:07.153157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.156470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ff4e07aa-904e-49b1-b066-7a51a7c7130b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.333409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 13/23] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:07.400294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072d39-1a93-425e-988f-e0c07d51c0a3 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.400792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072d39-1a93-425e-988f-e0c07d51c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.401339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1072d39-1a93-425e-988f-e0c07d51c0a3 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.404255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 11/24] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:07.417224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1494f0-e631-446e-927c-686f236fb5ca None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.418177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1494f0-e631-446e-927c-686f236fb5ca None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.418946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1494f0-e631-446e-927c-686f236fb5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.461392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6d1494f0-e631-446e-927c-686f236fb5ca None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.463915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6d1494f0-e631-446e-927c-686f236fb5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.508859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.605720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 14/25] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:07.727368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688667-98e1-4cdd-b32b-1c60467ec5d6 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.727633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688667-98e1-4cdd-b32b-1c60467ec5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.728033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28688667-98e1-4cdd-b32b-1c60467ec5d6 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.729545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 12/26] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:07.740202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.741183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.741964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.762845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0442-80df-4eb7-8cbe-b42ac98bb5b9 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.763109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0442-80df-4eb7-8cbe-b42ac98bb5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.763478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e0442-80df-4eb7-8cbe-b42ac98bb5b9 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.765078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:07.770840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.771200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.771456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.781520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.783031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.804962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.807463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.963695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 15/28] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:07.964202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.021486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 14/29] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 22:07:08.023460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.200256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.209510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.224166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd968da-a7ec-4b5b-a33c-ca9e99e782d4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.251915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2142e-f756-45cc-8e6e-9c57a69fe686 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.330513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.331184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.331462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.331731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.345240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.346702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.347439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.348194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.350327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.353418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.365870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:08.381612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:08.383215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:08.384552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 15/30] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:08.393910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.567617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca2cc-5839-40c9-87af-154de4096c5b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.596519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 16/31] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/roles => generated 225 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:08.599430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.611644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.612716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.613244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.613813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.614892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:08.615459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.617154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff0615-8055-42ba-b5e4-24abac0ce867 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.633438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 16/32] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:08.635450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a91b-71d7-430d-8dc2-55c54dbf09bc None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.635931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a91b-71d7-430d-8dc2-55c54dbf09bc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.636382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7a91b-71d7-430d-8dc2-55c54dbf09bc None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.637975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 17/33] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:08.638923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7a91b-71d7-430d-8dc2-55c54dbf09bc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.665076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.779184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7a91b-71d7-430d-8dc2-55c54dbf09bc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.800793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe679809-5036-46b3-a8ec-8f2d5e225e8f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.836059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.839612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.839612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.839612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.841920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.841920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.841920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.841920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.842366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.844001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.855856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.857841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.866550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 17/34] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 23 22:07:08 2022] POST /identity/v3/roles => generated 219 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:08.867814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-fea11e52-f383-4567-8a37-4efd24a9755c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:08.875261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:08.877017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 18/35] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdac3-e4fa-426f-9d49-2a718e53abab None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdac3-e4fa-426f-9d49-2a718e53abab None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.878569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcdac3-e4fa-426f-9d49-2a718e53abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.890241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.904766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-eedcdac3-e4fa-426f-9d49-2a718e53abab None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:08.906654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-eedcdac3-e4fa-426f-9d49-2a718e53abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:09.007305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.017742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 19/36] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:09.019754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97414d4-09b0-441b-8f1a-39f6e28d9940 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.020839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97414d4-09b0-441b-8f1a-39f6e28d9940 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.021318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97414d4-09b0-441b-8f1a-39f6e28d9940 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.024244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 20/37] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:09.030122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97414d4-09b0-441b-8f1a-39f6e28d9940 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.038519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc256e3-68dd-467a-a0fb-3df8ce90a22f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.091631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.092177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.092459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.092736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.094433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.096015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f0cb6-83e5-43a5-8e16-6195c57683a2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.097730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 18/38] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:09.099639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562f532-411a-43de-acfb-6921050410e5 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.099912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562f532-411a-43de-acfb-6921050410e5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.100308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562f532-411a-43de-acfb-6921050410e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.122304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9562f532-411a-43de-acfb-6921050410e5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:09.123952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9562f532-411a-43de-acfb-6921050410e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:09.210499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97414d4-09b0-441b-8f1a-39f6e28d9940 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.220845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 19/39] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:09.220845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562f532-411a-43de-acfb-6921050410e5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.225763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.293421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.295343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.296011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.296646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.298178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:09.299284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.303301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.320288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 21/40] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:09.321531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.344968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562f532-411a-43de-acfb-6921050410e5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.386183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.387051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.387516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.387982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.389755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.392095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.395975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 20/41] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:09.396154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.418114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.491324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e75af-d5c7-4ec6-ad84-a562902a6df6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.511270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.538118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.539070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.539423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.539739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.540611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.542332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.549896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a445d8-e5dd-493b-8e98-73a9dba6298c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.589812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.590425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.590706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.590978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.591633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.593145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.633681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 21/42] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:07:09 2022] POST /identity/v3/projects => generated 301 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:09.634420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.680941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 22/43] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 23 22:07:09 2022] POST /identity/v3/roles => generated 223 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:09.680941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.845285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9bcf0-7b07-4f3b-91ac-79525b322334 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.866095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88276f9d-1680-42cd-932a-da5bf3881574 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.882989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.911222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.912221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.912673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.913221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.913728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.915657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.918274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.924650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 23/44] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:09.933376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.936240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.937253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.937546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.937831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] PATH_INFO: `/v3/domains/default/users/ac0d80e10ea2452cb1a6dfc9b7ea1191/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.939945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.941528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7c68-7833-4997-80cb-54bf029921d2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.968281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 22/45] 10.222.0.69 () {58 vars in 1361 bytes} [Tue Aug 23 22:07:09 2022] PUT /identity/v3/domains/default/users/ac0d80e10ea2452cb1a6dfc9b7ea1191/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:10.074541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878b76f-6b78-4581-a1c7-631bb9885ee0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:10.123137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:10.124089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.124585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.125133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.125928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:10.127690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692586b-cb30-4601-8977-dcd6451c3f23 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:10.167398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:07:09 2022] POST /identity/v3/projects => generated 312 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:12.002116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc6b54-fd56-4040-a272-41c3963045ed None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.002889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc6b54-fd56-4040-a272-41c3963045ed None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.002889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc6b54-fd56-4040-a272-41c3963045ed None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.004949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 23/47] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:12.014105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062487-0f36-4ce2-b37f-ba8fcbe437d4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.014670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062487-0f36-4ce2-b37f-ba8fcbe437d4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.015055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062487-0f36-4ce2-b37f-ba8fcbe437d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.036218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2c062487-0f36-4ce2-b37f-ba8fcbe437d4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:12.037863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2c062487-0f36-4ce2-b37f-ba8fcbe437d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:12.075568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.125525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 25/48] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:12.189242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5b0c-1c09-4c23-8cd2-4e29c7416dd3 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.189604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5b0c-1c09-4c23-8cd2-4e29c7416dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.189981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5b0c-1c09-4c23-8cd2-4e29c7416dd3 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.192544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 24/49] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:12.199794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.200197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.200557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.345578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:12.347146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:12.416003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5b0c-1c09-4c23-8cd2-4e29c7416dd3 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.448067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 26/50] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:12.565162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5b0c-1c09-4c23-8cd2-4e29c7416dd3 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.627610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.628601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.629142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.630134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.651687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:12.662704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:12.664468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:12.666307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 25/51] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:12.673186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.788681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.821804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.829349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60285f44-b46c-4fdc-b4f7-2a4925a8d7be None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.851736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.886172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.887080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.887560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.888012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.889211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:12.889750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.892317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.905864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 27/52] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:12.913120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.928277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364802f-bdbb-43e2-b6e2-2a3f057f6876 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.979475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.980131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.980423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.980705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.981962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.983467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.985140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:12.993797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.045697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97ffe7-0dc6-435e-8f45-a6d2f08c0ff7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.086608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.087265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.087548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.087827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.089066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.090582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.092226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 28/54] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:13.098654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.136416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.146688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e108f68-0efa-4770-aab2-dbe31a6dc4a4 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.165824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.195625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.196399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.196730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.197080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.197814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.199387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.252850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 27/55] 10.222.0.69 () {60 vars in 1140 bytes} [Tue Aug 23 22:07:12 2022] POST /identity/v3/projects => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:13.261073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101aae4-881d-4cc6-949c-366c69ca6f38 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.323787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.324944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.325415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.326003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.328045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.330817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fc382-c7b9-46b3-b9bb-e0644f528f64 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.334053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 29/56] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:13.342203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.475806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd09e-7d8f-4fb3-9b8b-e0156d3c73d5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.518850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.520297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.520638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.520988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.521928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.domain.id=default, user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:13.522239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.523764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62564744-b036-49ca-97f0-9933debfca19 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.530311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1322 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/role_assignments?user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191&scope.domain.id=default&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 530 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:15.308938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0359-7726-437d-96a3-c9be4c96319e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.309507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0359-7726-437d-96a3-c9be4c96319e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.309507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d0359-7726-437d-96a3-c9be4c96319e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.310872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 30/58] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:15.318925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.321025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.321025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.343542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:15.344799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:15.370903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:15.540360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 29/59] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:15.812532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0359-7726-437d-96a3-c9be4c96319e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:15.923719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:15.931297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d0359-7726-437d-96a3-c9be4c96319e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:15.970995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:15.971704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.972032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.972350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.973670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:15.975230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09370025-7470-4a6e-b374-dec8b4755f46 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:15.976933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 31/60] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:15.982984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.102003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e99789-474b-4d06-aa79-5e054031d81c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.145868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.146503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.146786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.147061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.147792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:16.150075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0f1d-6bec-4670-abc0-527bb987a536 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:16.190084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 30/61] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:15 2022] POST /identity/v3/users => generated 275 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:19.587494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea0d-c6ba-4a4b-afa8-c03f9aa8d0ec None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.589126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea0d-c6ba-4a4b-afa8-c03f9aa8d0ec None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.589914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aea0d-c6ba-4a4b-afa8-c03f9aa8d0ec None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.593199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 32/62] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:19.603673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cd225-76a6-4f08-8f5b-e2b979ef0d03 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.605192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cd225-76a6-4f08-8f5b-e2b979ef0d03 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.605996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cd225-76a6-4f08-8f5b-e2b979ef0d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.649476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-217cd225-76a6-4f08-8f5b-e2b979ef0d03 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:19.651937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-217cd225-76a6-4f08-8f5b-e2b979ef0d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:19.680829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:19.815374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 31/63] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:19.878712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248993a-ff95-4158-854f-af747b7f90fd None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.879356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248993a-ff95-4158-854f-af747b7f90fd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.879851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248993a-ff95-4158-854f-af747b7f90fd None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.882604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 33/64] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:19.891084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e2ad-a086-4a8f-a541-0b0da9ce90a9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.891395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e2ad-a086-4a8f-a541-0b0da9ce90a9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.891679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126e2ad-a086-4a8f-a541-0b0da9ce90a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.913497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2126e2ad-a086-4a8f-a541-0b0da9ce90a9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:19.915025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2126e2ad-a086-4a8f-a541-0b0da9ce90a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:20.014009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 32/65] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:20.158729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6a26-09b5-43fb-bda7-ce61aa075c5b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.159189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6a26-09b5-43fb-bda7-ce61aa075c5b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.159610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c6a26-09b5-43fb-bda7-ce61aa075c5b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.162017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 34/66] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:20.168371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc20ef-86d8-4e3b-95a8-7b3a1b1df26f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.168993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc20ef-86d8-4e3b-95a8-7b3a1b1df26f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.169484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc20ef-86d8-4e3b-95a8-7b3a1b1df26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.193438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e0bc20ef-86d8-4e3b-95a8-7b3a1b1df26f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:20.194948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e0bc20ef-86d8-4e3b-95a8-7b3a1b1df26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:20.287551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c6a26-09b5-43fb-bda7-ce61aa075c5b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.300607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 33/67] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:20.355890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6e91-9e1e-4979-b365-400167ec743d None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.356208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6e91-9e1e-4979-b365-400167ec743d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.356464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6e91-9e1e-4979-b365-400167ec743d None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.357996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 34/68] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:20.377364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.377882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.378377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.402473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.433953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:20.435180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:20.528206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c6a26-09b5-43fb-bda7-ce61aa075c5b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.580251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 35/69] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:20.581527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.607167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.609663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.609956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.610348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.625439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-a1df823a-54c8-4a55-b20e-b5f118309c40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:20.630446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:20.632137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 35/70] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:20.641918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a241af-233e-4474-82de-6fe627573ff5 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.642734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a241af-233e-4474-82de-6fe627573ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.642734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a241af-233e-4474-82de-6fe627573ff5 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.642734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 36/71] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:20.642734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a241af-233e-4474-82de-6fe627573ff5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.674924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.720686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa97d-97b4-40b6-91ff-2af6921628b7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.764598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.765700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.766192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.766695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.770598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.785272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-e1ef8023-35c3-44c8-8803-d6517cbb673e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:20.790994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:20.792034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:20.792902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:20.796903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a241af-233e-4474-82de-6fe627573ff5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.797279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 36/72] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:20.799198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.799505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.799767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.819629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:20.820898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:20.853289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.854432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.854985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.855848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.870773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:20.875692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:20.876883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 37/73] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:20.878528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.904736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 37/74] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:20.906328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.976047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.996892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c1d56-57ea-430a-8e40-3d437b16c134 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.036947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.037594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.037874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.038146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.038843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:21.039148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.040576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.050169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 38/75] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.051498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.093982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d7ed3-c271-448c-a076-0676e9e96acd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.130508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.148706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.149412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.149742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.150067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.150795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:21.151146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.152596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.164679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 38/76] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.166224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.204382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862cbb9-de69-48b1-9a3a-faa112b88392 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.253758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.255522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.255812 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.256090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.271867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:21.281086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:21.281963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:21.282723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:21.283376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 39/77] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:21.284281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.298107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.310251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ca4f0-5005-4ea0-a2d4-8305e1cf505f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.350660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.351688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.352165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.352660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.353903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:21.354452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.357089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.371925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 39/78] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.373515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.403857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f0f25-79eb-4aa4-b431-53974c1da0e1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.435237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.443644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.444732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.445116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.445455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.463277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.465158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.467026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 40/79] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.468108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.500208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74daa069-b93b-4fe9-a095-fe951ee772d4 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.545407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.546059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.546363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.546649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.547815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.549337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.551947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 40/80] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.552835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.553739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.596594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb6cb7-5954-4fcd-b4e5-d0aa2f6f4fd8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.638088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.639085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.639538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.639986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.641464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.645890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.647331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 41/81] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.648149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.673799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0250a79-9c03-48f8-901b-4875ae462907 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.693091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.715891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.716991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.717501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.718005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.719237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:21.719795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.722505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.737808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 41/82] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.739834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.776365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6ff56-0163-4b97-ab5d-30fcbafb45f5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.814991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.821592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.822242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.822522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.822800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.823972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.825485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.827106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 42/83] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.833130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.871506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5606a4d-442b-4b06-9b67-85a68e0ad27f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.910445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.911150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.911350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.911632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.948511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828ba8-1ce3-40a7-bae7-2c3ef74938ab None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.961801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.986586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.987410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.987692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.987872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.987969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.990192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.060326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.062848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.064476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.098798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 42/84] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:22.099660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.185641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.199042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 43/85] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:22.199803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.210251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8eed5-cffa-4e26-b97a-a313e35f8449 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.246811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.247451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.247742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.248022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.248703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.250199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.275346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 43/86] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:22 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:22.276240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.345560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.352763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7da30-00d5-4012-bd87-248c3ec81cca None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.416892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.418088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.418618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.419140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.421431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.423936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.424952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3fd3c-2810-45db-a13f-808107e5862f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.427447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 44/87] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.428869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.480078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.480634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.481558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.481558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.484351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.584513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640614c3-f12f-4100-b9e1-d003514d32a4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.584745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.587513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.636284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.637032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.637320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.637664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.639035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.640517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.643074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 45/88] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.643662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.695496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.742443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 44/89] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:22.743214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.792321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.795705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718f6b-93c0-4a28-a213-2807c2ba1733 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.844037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.844697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.845101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.845385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.846573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.848836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.850753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 46/90] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.851743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.882579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f88c35-90cf-4da5-8a7d-f5595de9e931 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.921271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.922000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.922285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.922565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.971255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69121c3-a590-4d87-9aa0-44cae66c9594 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.974979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.007711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.009531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.013326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.013959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.014300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.014578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.015383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.015703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.017279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.026384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 47/91] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=2db6f108db484377bb8284827c2bc59c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.027354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.049587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.131177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 45/92] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:23.132263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.151375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f2a15-b1f3-4837-8a48-78bb16db1ee2 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.197349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.197847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.198143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.198423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] PATH_INFO: `/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.199641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] RBAC: Authorizing `identity:get_project(project_id=7bbc66c9f83c44fdbe0123b6cceefc02)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.201292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.203196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 48/93] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.204039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.247094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.257666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a880c-33d4-45d5-b045-cfa6d9319a62 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.300890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.301877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.302305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.302830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.303811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.304281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.306031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.308387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.313705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 46/94] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/role_assignments?user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.314913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.365771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1d5d1-692d-4191-bd58-baa2be109b8d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.458044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.459002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.459460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.459893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.462982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.464738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.469682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 49/95] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.479556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.556313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a406d-f724-478e-b919-8c3239a0c778 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.640865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.640865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.640865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.640865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.641428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=7bbc66c9f83c44fdbe0123b6cceefc02, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.641762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.643300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac61d5-cf99-4005-8228-ffae68c99324 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.652340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 47/96] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=7bbc66c9f83c44fdbe0123b6cceefc02&role.id=2db6f108db484377bb8284827c2bc59c => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.689239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6803fe-82d9-4238-9a73-6dffd273b044 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.699935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.745873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.746584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.746870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.747150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.747979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.748291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.749819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9609705-5f5b-4465-b8af-1374539e3dce None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.758627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 50/97] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:25.484802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41509403-de60-4e82-9e2f-7f5000c63a89 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:25.485604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41509403-de60-4e82-9e2f-7f5000c63a89 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:25.485604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41509403-de60-4e82-9e2f-7f5000c63a89 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:25.487382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 48/98] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:25.495160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:25.495854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:25.495854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:25.516529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:25.517889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:25.599105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 51/99] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:25.978769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41509403-de60-4e82-9e2f-7f5000c63a89 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:26.058320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:26.106977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41509403-de60-4e82-9e2f-7f5000c63a89 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:26.178030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:26.179840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.180674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.181425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.190300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:26.193866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28792e9-c1a4-4546-a0a5-5fcb30c32d92 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:26.197489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 49/100] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:26.206454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:26.373153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:26.377657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b4ba9-914c-4212-843b-8d7a1cb910de None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:26.421498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:26.422150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.422427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.422697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.423370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:26.424929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a8198-c658-486c-95a4-3e9141bc0d7d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:26.462455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 52/101] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:07:26 2022] POST /identity/v3/projects => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:26.601528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f561b-ceea-4e49-b6d4-1e5df5984037 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.602572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f561b-ceea-4e49-b6d4-1e5df5984037 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.602572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f561b-ceea-4e49-b6d4-1e5df5984037 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.603504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 50/102] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:26.609842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e2fe-c532-45da-9df0-cad3b667d3c2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.610715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e2fe-c532-45da-9df0-cad3b667d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.610715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e2fe-c532-45da-9df0-cad3b667d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.636451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d1e7e2fe-c532-45da-9df0-cad3b667d3c2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:26.637689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d1e7e2fe-c532-45da-9df0-cad3b667d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:26.737390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 53/103] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:27.062493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e32f-1198-44fb-b6aa-b1c29fc7b20f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.062866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e32f-1198-44fb-b6aa-b1c29fc7b20f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.063055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e32f-1198-44fb-b6aa-b1c29fc7b20f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.064394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 51/104] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:27.075303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.075619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.075857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.100547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:27.101806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:27.155155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b917c8-50c0-4a97-a97b-009fd45dfdaf None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.155440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b917c8-50c0-4a97-a97b-009fd45dfdaf None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.155749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b917c8-50c0-4a97-a97b-009fd45dfdaf None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.157289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 52/105] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:27.166501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861adc-bcce-4390-acec-abd3501b7bf8 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.166805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861adc-bcce-4390-acec-abd3501b7bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.167059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a861adc-bcce-4390-acec-abd3501b7bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.201957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 54/106] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:27.218071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7a861adc-bcce-4390-acec-abd3501b7bf8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:27.220100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7a861adc-bcce-4390-acec-abd3501b7bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:27.361519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 53/107] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:27.372849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.398595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.541678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d0d3f-1d72-434e-997e-2c2b06f259fd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.588834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad947-8cc8-43e6-b2a9-f0a5e27e8488 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.588834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad947-8cc8-43e6-b2a9-f0a5e27e8488 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.588834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad947-8cc8-43e6-b2a9-f0a5e27e8488 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.588834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 54/108] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:27.594644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.595204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.595701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.620746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:27.622868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:27.634743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.636141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.636697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.637192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.668127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:27.673559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:27.674476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:27.675228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:27.678305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 55/109] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:27.691433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.812067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.827539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.836612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 55/110] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:27.837543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.875985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcfd9c-b3a5-4c6e-bed1-8042aca83cd6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.958598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.959825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.960110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.960571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.961908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:27.962864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:27.965095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:27.981859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 56/111] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:27.987877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.057512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b415ec-4c1c-4fc0-898d-d6b3f07d08c9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.139524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.141362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.142429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.143072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.169457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:28.182098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:28.183015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:28.183890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:28.186450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 56/112] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:28.188053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.228966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720b913-4553-4307-a84e-cf8b4a20d637 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.260687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.272380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.278028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.278847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.279143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.279422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.292340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:28.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:28.298630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:28.299386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 57/113] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:28.300123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.322216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51802a4-22d5-4717-bac5-13397d27a12b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.359643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.360290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.360569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.360870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] PATH_INFO: `/v3/users/3d5131428f7c439c90a6d356aaf355ba` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.377267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] RBAC: Authorizing `identity:get_user(user_id=3d5131428f7c439c90a6d356aaf355ba)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.379157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e57660-faaf-4c6a-9351-52bea48fc12d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.380989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 57/114] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/users/3d5131428f7c439c90a6d356aaf355ba => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.382294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012a00-0051-40f4-8259-31479d10e8a8 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.382579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012a00-0051-40f4-8259-31479d10e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.382852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f012a00-0051-40f4-8259-31479d10e8a8 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.384268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 58/115] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:28.389224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012a00-0051-40f4-8259-31479d10e8a8 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.427688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcec9c0-b383-48aa-a02a-de0115d12429 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.465126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.465810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.466730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.467021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.467735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:28.468042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.469522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.480160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 58/116] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.481475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.524667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f012a00-0051-40f4-8259-31479d10e8a8 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.535712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.551967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.573724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.574484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.575783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.575783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.589368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:28.599394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:28.601040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 59/117] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:28.602271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.623516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e62a4-d3da-471c-b32c-fb574f8d7095 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.666817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.667516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.667738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.668014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.668712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:28.669054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.670488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe600f-7522-4b05-bbf4-ae76c3552563 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.684393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 59/118] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.684393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.684393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.684393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.708605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:28.710878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:28.756067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1d037-826a-47d9-9897-176b0bc56a89 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.797896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.798612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.798818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.799095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.804581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 60/119] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:28.817164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.851224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.874799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.895958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.897696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.937952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0471fde-ac2a-4f4f-b18c-b522bfe94f46 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.981891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.982600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.982880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.983162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.984501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.986113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.993225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 61/120] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.994275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.036844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 60/121] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:29.037730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.106915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba03b0a-4e10-4858-8f9b-f0df3d26ae22 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.122254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.123371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.146133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.146764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.147044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.147317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.147997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.148301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.149748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.161136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 62/122] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.161136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.166073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f001a10-3ce4-4758-a446-56e1c26a5eb0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.205766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.206332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.207082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.207082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.208103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.209612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.211484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 61/123] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.212119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.297114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7467775-9b8c-42fe-a431-8db6002a9759 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.329368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15f7cc-1bb2-4dc0-ba37-d1ba60489fa2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.333988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.334846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.335275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.335685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.337025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.338629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.340464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 63/124] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.341430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.372661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.373353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.373638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.373916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.375149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.376645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.378546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 62/125] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.381783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.388126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.399519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.464188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cffc89-defd-4a0c-b3df-21ab3b829583 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.503569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.504860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.505155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.505419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.516883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:29.517129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbceb43-b58c-402f-9d32-275451f86ab8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:29.523180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:29.524149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 64/126] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:29.529573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.570044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.570967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.571310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.571771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.573727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.575600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.580897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 63/127] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.580897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.678411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5492b-70a6-438e-aa94-1e15820e26f1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.681743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.688459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.723836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.724519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb8d9f-935a-431e-b701-6987590774a8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.724931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.725342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.725772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.727339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.728857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.735358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 65/128] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.735358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.764690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.765402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.765686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.765959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/ac0d80e10ea2452cb1a6dfc9b7ea1191/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.767899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.769983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.792849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 64/129] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:29 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/ac0d80e10ea2452cb1a6dfc9b7ea1191/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:29.792849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.867104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61a8f9-6599-4513-b3f6-4b1731ac581d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.912347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.913148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.913498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.913836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.914811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=3d5131428f7c439c90a6d356aaf355ba) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.915200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.917033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.924062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 66/130] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/role_assignments?user.id=3d5131428f7c439c90a6d356aaf355ba&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=948e35a24a684b48b4ce539aae40b004 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.925123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.949583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeda3c-f153-4079-9539-7a61358b7805 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.976580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.023839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.037688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.038343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.039239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.040094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.042986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:30.043384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.046306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.066392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 65/131] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.068464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.084756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0896-53d2-4212-9726-211dc9036f43 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.159435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.160580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.161157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.161688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.163754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.166193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.169185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 67/132] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.170410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.363137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1ac9d-c6a3-4ce2-8d4c-77f73d244be3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.428660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095b2a4-ba6a-41b7-9a88-8fdc1482f740 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.434569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.484114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.484114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.484114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.484114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.485400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.486245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.486669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.492513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.492513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.493269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.494115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 68/133] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.495100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.497373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, user_id=7a301020d0bc4b55a9a3731f0f6b65a7, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.503919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfd06d-52d0-4e6a-9a60-44561709c98a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.519835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 66/134] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:30 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:30.522186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c91c5-cf8c-4889-9668-cdcee4603c7f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.522633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c91c5-cf8c-4889-9668-cdcee4603c7f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.523137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c91c5-cf8c-4889-9668-cdcee4603c7f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.530641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 67/135] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:30.531920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c91c5-cf8c-4889-9668-cdcee4603c7f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.630694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.699700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c91c5-cf8c-4889-9668-cdcee4603c7f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.746330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.747475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.747903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.748383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] PATH_INFO: `/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.750189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] RBAC: Authorizing `identity:get_project(project_id=7bbc66c9f83c44fdbe0123b6cceefc02)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.752095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366f66d-3fb6-459e-ad9d-3abfe910f980 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.755600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 68/136] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.757453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.757940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.758383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.781917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:30.784773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:30.815460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b107e-28d5-494b-afac-a92b5be301f5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.879725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.880847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.881361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.881818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.884928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, user_id=7a301020d0bc4b55a9a3731f0f6b65a7, role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.887669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.912246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 69/137] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:30 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:30.913998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.926173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 69/138] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:30.993584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.147656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478f706-052c-4027-b770-1c154b595db5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.226083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.227689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.228433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.229192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] PATH_INFO: `/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.239578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] RBAC: Authorizing `identity:create_grant(project_id=7bbc66c9f83c44fdbe0123b6cceefc02, user_id=7a301020d0bc4b55a9a3731f0f6b65a7, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.243463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.273585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 70/139] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:30 2022] PUT /identity/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02/users/7a301020d0bc4b55a9a3731f0f6b65a7/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:31.401186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.490810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.565449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf9e79-f588-498f-9959-2aa9dced164c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.621540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.622716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.623155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.623586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.630086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.632039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd146c-1c4c-412d-ac88-f9c097dcf75d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.634015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 70/140] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.641053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.862954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.881641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32ecca-cce5-48d2-b3e0-38969679c05e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.967435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.968450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.968970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.969456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.970709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.975583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f241f-e83b-43d2-81f7-24214b7fc894 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:32.050171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 71/141] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:31 2022] POST /identity/v3/users => generated 283 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:32.442464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5c02-0118-47f7-a31e-6f957399932f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.443978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5c02-0118-47f7-a31e-6f957399932f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.444728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5c02-0118-47f7-a31e-6f957399932f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.447639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 71/142] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:32.455006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdce02-50fa-468b-b615-66f80ff9ee78 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.455475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdce02-50fa-468b-b615-66f80ff9ee78 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.455964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdce02-50fa-468b-b615-66f80ff9ee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.504876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fbfdce02-50fa-468b-b615-66f80ff9ee78 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:32.504876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fbfdce02-50fa-468b-b615-66f80ff9ee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:32.618298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 72/143] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:32.949780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5c02-0118-47f7-a31e-6f957399932f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.977672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0546-9748-43e4-aa89-8a55cb1ecbf3 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.978213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0546-9748-43e4-aa89-8a55cb1ecbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.978286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f0546-9748-43e4-aa89-8a55cb1ecbf3 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.979746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 73/144] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:32.990240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.991310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.992511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.027791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:33.030689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:33.120240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 74/145] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:33.123809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5c02-0118-47f7-a31e-6f957399932f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.162031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.185543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.186204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.186489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.186767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.200155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:33.205288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:33.207924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:33.209510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 72/146] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:33.227880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.257242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.400487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8163ee-86bf-45ee-8e64-8ea5d4d807fc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.443898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be420-3de7-4941-bb81-258349711b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.444529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be420-3de7-4941-bb81-258349711b23 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.444820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be420-3de7-4941-bb81-258349711b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.445098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770be420-3de7-4941-bb81-258349711b23 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.445774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be420-3de7-4941-bb81-258349711b23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:33.446116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be420-3de7-4941-bb81-258349711b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.447503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770be420-3de7-4941-bb81-258349711b23 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.460623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 75/147] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:33.466591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.602705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be420-3de7-4941-bb81-258349711b23 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.650847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b00c2-f904-4499-8dbc-99769d36708d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.700125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.701214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.701668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.702130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] PATH_INFO: `/v3/users/3d5131428f7c439c90a6d356aaf355ba` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.706293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] RBAC: Authorizing `identity:get_user(user_id=3d5131428f7c439c90a6d356aaf355ba)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.708954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.711302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 73/148] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/users/3d5131428f7c439c90a6d356aaf355ba => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:33.724247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.781740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.842714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.856873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770be420-3de7-4941-bb81-258349711b23 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.906129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.907558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.908069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.908606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.923372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-32c96b0d-bd39-42da-b5a1-cf33c633fd43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:33.930218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:33.931135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:33.931925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:33.934742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 76/149] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:33.936375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e9c2-4d37-43ba-8fbb-865b42c14c54 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.936904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e9c2-4d37-43ba-8fbb-865b42c14c54 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.937379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e9c2-4d37-43ba-8fbb-865b42c14c54 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.938971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 77/150] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:33.944017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e9c2-4d37-43ba-8fbb-865b42c14c54 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.970910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e20a90-8a42-40a9-9041-869c1aef2627 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.065574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.066248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.066534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.066820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.068179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.069524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5bf82-9ae0-49ef-8626-2fa5d9486faa None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.071204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 74/151] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:34.072367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.072650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.072960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.092341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e9c2-4d37-43ba-8fbb-865b42c14c54 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.102584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:34.103800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:34.127901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.137119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.138032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.138474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.138890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.139761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:34.140204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.141788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.153718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 78/152] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:34.154800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.271665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 75/153] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:34.272570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.276770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469a122-3fb7-4d9b-9d4a-5c9f49a6b656 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.318329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.319305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.319726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.320225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/3d5131428f7c439c90a6d356aaf355ba/roles/948e35a24a684b48b4ce539aae40b004` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.322445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, user_id=3d5131428f7c439c90a6d356aaf355ba, role_id=948e35a24a684b48b4ce539aae40b004)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.324279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.346404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 79/154] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:34 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/users/3d5131428f7c439c90a6d356aaf355ba/roles/948e35a24a684b48b4ce539aae40b004 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:34.371998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.450475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e9379-2e6a-4ba7-a354-8580c4176b67 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.495771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.496443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.496705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.497014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] PATH_INFO: `/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.498222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] RBAC: Authorizing `identity:get_user(user_id=ac0d80e10ea2452cb1a6dfc9b7ea1191)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.499993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbced17-d8bb-42d3-a844-679ff7b963a8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.501654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 76/155] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/users/ac0d80e10ea2452cb1a6dfc9b7ea1191 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:34.509336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.587813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.651008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340b0e-a8a3-4549-91fb-5ae3ec08efd5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.697943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.698633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.698920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.699195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.798671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.800231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.872286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.921246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc12-5f0d-4c72-9bee-415ef151f8b6 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.921548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc12-5f0d-4c72-9bee-415ef151f8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.921792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2cc12-5f0d-4c72-9bee-415ef151f8b6 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.923287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 77/156] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:34.930771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.931108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.931318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.967636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 80/157] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:34.975545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.981548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:34.983205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:35.118598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fc770-65a1-4487-ac00-858ddcce2127 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.128973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 78/158] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 22:07:35.130096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.163422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.164271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.164559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.164858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.166190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.167809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.170098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 81/159] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.177831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.208852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.225259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.327530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad96eb-0371-4d16-94f9-f37a90cdcfb7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.331313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e3cb2-f1bf-4f20-ada3-dffa709ffb74 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.385662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.386304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.386517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.386786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.404676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.405410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.405691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.406140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.407123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:35.407569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.410719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82610f-c5aa-4cf4-902b-5b6de4b80271 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.418132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:35.423559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:35.424578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:35.426454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:35.428548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 79/160] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:35.433384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 82/161] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/role_assignments?user.id=ac0d80e10ea2452cb1a6dfc9b7ea1191&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.435073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.609480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972907-e65a-4c02-9d9b-fe9777bea625 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.619677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.657107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.657664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.657947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.658225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.658923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:35.659234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.662247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.663233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa614-90a9-4dea-92a5-9922880010b9 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.663517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa614-90a9-4dea-92a5-9922880010b9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.663833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaa614-90a9-4dea-92a5-9922880010b9 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.665272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 83/162] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:35.680089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.680282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 80/163] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.680483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.680704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.689310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.746313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:35.753155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:35.959491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 84/164] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:35.961779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.964726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298451-2514-4fda-8971-0aee4d38ae0c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.012077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.060709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.061763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.062266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.062753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.065592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.067403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.069671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 81/165] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:36.076197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.155622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.215264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ede3b-ba17-4250-a2bc-28f6153d97d2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.295424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.296552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.296861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.297168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.322270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:36.327614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:36.329241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:36.330913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 85/166] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:36.358820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286376bb-e433-466c-bbaf-3a3e6bc8c9e8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.365391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.474395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.474956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.475240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.475520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.549978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.617945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87710a09-3c50-4dd9-ac90-c33046f9aff1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.654223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.657234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.705292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.705945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.706226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.706577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.707337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:36.708011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.709549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.729217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 86/167] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:36.730638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.737761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.969698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 82/168] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 894 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:36.971667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.992033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c08311-0343-4fe8-aef1-bc9e2cc7dc75 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.082463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.083504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.084828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.085497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.099218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.113473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:37.120286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:37.121297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:37.122096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:37.130008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 87/169] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:37.131122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.224965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de9d72-a27e-494f-a35b-08772a11018c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.308888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.310011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.310498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.310976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.316539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.319485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca32aa7-2faf-4adf-a151-fe333d7417ff None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.323220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 83/170] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:37.336212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958786-bc2c-4785-93a7-bafa3ffc5969 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.336695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958786-bc2c-4785-93a7-bafa3ffc5969 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.337267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958786-bc2c-4785-93a7-bafa3ffc5969 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.339730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 84/171] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:37 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:37.347640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958786-bc2c-4785-93a7-bafa3ffc5969 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.356652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.389528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa804cb-1d8f-4106-a098-fe344c9b5164 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.467966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.468970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.469427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.469871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.471521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.474358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.481096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 88/172] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:37.482361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.562032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.568318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4958786-bc2c-4785-93a7-bafa3ffc5969 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.631897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34c2cd-4a66-427d-a9c2-27495f76cd5e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.637266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.638242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.638743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.639371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.640344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:37.641650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.644170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbbe46-add6-4f37-b2b9-7c0572c3e4b2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.657090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 85/173] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:37.660740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f0a4-a182-428a-b42b-43037d535fb9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.661320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f0a4-a182-428a-b42b-43037d535fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.662086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8f0a4-a182-428a-b42b-43037d535fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.677617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.678549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.679083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.679501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.692107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4df8f0a4-a182-428a-b42b-43037d535fb9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:37.693648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4df8f0a4-a182-428a-b42b-43037d535fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:37.778672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.793007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 86/174] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:37.794569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044bc1-953b-4957-93ca-640361a4462f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.794859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044bc1-953b-4957-93ca-640361a4462f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.795139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59044bc1-953b-4957-93ca-640361a4462f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.800957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 87/175] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:37.800957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044bc1-953b-4957-93ca-640361a4462f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.811058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.813075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.889908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.937823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 89/176] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:37.939010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.032398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59044bc1-953b-4957-93ca-640361a4462f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.061080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8112489-ff28-4259-bd6a-8dd85a508eec None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.104223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.104957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.105242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.105417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.105568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] PATH_INFO: `/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.105892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.106290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.106606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.106767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] RBAC: Authorizing `identity:get_user(user_id=7a301020d0bc4b55a9a3731f0f6b65a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.107346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:38.107652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.108115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be51e5d-04cb-47a3-abeb-cd965d4e2713 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.109650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 90/177] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/users/7a301020d0bc4b55a9a3731f0f6b65a7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b19b-e829-48bc-a2ff-12646995305e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b19b-e829-48bc-a2ff-12646995305e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3b19b-e829-48bc-a2ff-12646995305e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 91/178] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:38.117227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.117952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.117952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.118180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 88/179] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=2db6f108db484377bb8284827c2bc59c => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.120792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.160950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:38.163591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:38.194803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.229602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.249283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02e883-fe9b-45ea-b51e-07c17d9a5dac None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.295733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.295733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.296126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.296126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] PATH_INFO: `/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.297911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] RBAC: Authorizing `identity:get_project(project_id=7bbc66c9f83c44fdbe0123b6cceefc02)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.300104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.302507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 89/180] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/projects/7bbc66c9f83c44fdbe0123b6cceefc02 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.309142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.332673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 92/181] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:38.340939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.458127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9127ea7-6e81-4f83-8e71-5b6bf09729a3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.485642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1be54-e296-4c80-b99c-692b9ef54133 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.496566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.513665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.514344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.514848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.515317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.528046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:38.529548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.530186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.530462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.530753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-aa7f4cca-70a7-46b2-95ef-66709b614919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:38.533788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:38.537109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 90/182] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:38.538244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.539205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.539205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.565015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:38.566407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:38.580572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.634007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.636093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df90ca8-21f3-440a-884a-e7d063037788 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.657364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 91/183] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:38.662582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.764489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 93/184] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:38.765905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73a0a-6dd0-4fd6-968a-55c02317cf64 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.766189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73a0a-6dd0-4fd6-968a-55c02317cf64 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.766461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b73a0a-6dd0-4fd6-968a-55c02317cf64 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.767774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 94/185] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:38.768480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73a0a-6dd0-4fd6-968a-55c02317cf64 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.807179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3cc7-94b1-4a72-9344-a8c89af97a76 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.831273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.856597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.857239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.857517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.857833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.858568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=7bbc66c9f83c44fdbe0123b6cceefc02, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:38.859405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.861054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.870384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 92/186] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=7bbc66c9f83c44fdbe0123b6cceefc02&role.id=2db6f108db484377bb8284827c2bc59c => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.872035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.881876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.963136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b73a0a-6dd0-4fd6-968a-55c02317cf64 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.020347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.020916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b5c4-1434-47ae-8394-22affe6754dd None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.021026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.021275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.021548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.022249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.022553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.023990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.034546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 95/187] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.035983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.073489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.074145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.075210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.075517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.090403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-192b0e70-1aff-4770-9f73-32ee95fb37c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:39.095659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:39.096598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:39.098123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 93/188] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:39.101207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.101207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.101207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.120980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:39.122290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:39.175547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.195644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24badf00-ec5f-4665-9027-89f95a4303f5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.218751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 94/189] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:39.219758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.222452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.236072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.236494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.236768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.237067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.239548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.240601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.242769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 96/190] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.243502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.369460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362fb79-afb9-421d-afd4-f4fa23ba08c7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.407863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521f955-f57b-487d-a79b-7ddaf10bb372 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.422028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.422691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.422974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.423250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.424441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.427096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.428996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 95/191] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.434415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.470566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.471757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.472167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.472656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.486581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.495128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.497264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.506295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 97/192] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.506295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.573156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.583590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95490d57-e7ae-459b-999a-e9cea39d9c7f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.627725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.629232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.629664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.630334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.631507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.632022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.634324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.646092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682a77e-ebb7-4249-bb87-6a95398c9d9a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.654338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 96/193] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.654338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.706594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.707364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.707602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.707957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.709050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=7a301020d0bc4b55a9a3731f0f6b65a7) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.709478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.711126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.718308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 98/194] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/role_assignments?user.id=7a301020d0bc4b55a9a3731f0f6b65a7&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.718957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.818186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.824404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7f592-17aa-4e0b-baa7-f22f49c5359c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.871344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.871985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.872272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.872547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.873245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.874251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ecae0-cdf3-4476-aac3-82bbc9e1b41c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.874839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.896633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.904063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 97/195] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:39 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:39.906718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.931820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.932520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.932992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.933182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.044108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.045636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.082702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c88cb-4235-4c8e-9a03-fed9d9a2ff78 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.124090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.124966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.125251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.125529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.126758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.128276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.130499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 98/196] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.131288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.165148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.204552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 99/197] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:40.205505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.227149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.295922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86034555-5afe-4bbf-b260-937c7ef9e783 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.342395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.343430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.343945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.344441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.358699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:40.363591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303df82-a312-43ef-b063-5fdcd325764c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:40.364500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:40.365405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:40.366255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 99/198] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:40.366923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.422805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.424065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.424065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.424065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.491504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.510399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0bce-9140-4b27-8034-5540b37b6f9f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.513673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.515489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.541374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.549787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.551084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.551413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.551754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.553088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.554655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.556427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 100/199] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.557313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.656756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 100/200] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:40.658224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.670036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3ded-06d5-4268-b5b5-925319c1adf8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.709047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.709691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.710041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.710383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.711152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:40.711519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.713101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.725163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 101/201] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.726519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.748999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.788024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a8583-b1e1-40e3-932b-f1fd042edafc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.815086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.852646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.853696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.854214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.854800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.856019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=28670002ab2d445984fd8811844edac1) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:40.856482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.859357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.874291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 101/202] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/role_assignments?user.id=28670002ab2d445984fd8811844edac1&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.874291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.910500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72dc39-5b90-4b1d-957d-2d239fdd228a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.000002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.000630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.000953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.001383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.005083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.006604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.008732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 102/203] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.015900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.090929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85f9c-d85b-4bf1-a3dc-0ea11219ad27 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.132540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.133592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.134074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.134545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] PATH_INFO: `/v3/users/3d5131428f7c439c90a6d356aaf355ba` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.138146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] RBAC: Authorizing `identity:get_user(user_id=3d5131428f7c439c90a6d356aaf355ba)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.139855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.141888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 102/204] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/users/3d5131428f7c439c90a6d356aaf355ba => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.148577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.194607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.207739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.255431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8abbe0-d95e-4bdb-ac95-daa0a9a9e8e8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.276126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888ba8-b1ed-433d-a758-179185f84630 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.326650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.327694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.328350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.330300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.359591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.360579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.363376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.364201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.366741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=28670002ab2d445984fd8811844edac1) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:41.368244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.369970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.385356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 103/205] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/role_assignments?user.id=28670002ab2d445984fd8811844edac1&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 259 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.507182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.510464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.606389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.685892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 103/206] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:41.692923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.866534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037fc38-0b2f-4405-80a0-452eefab357d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.911988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.912662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.912918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.913186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.914343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.915830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc941b85-f6ec-4d1f-bd8e-191a4287ae5e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.917851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 104/207] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.923438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:42.112086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fab26-fd7a-4a6d-8113-0e8ff9355751 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:42.211702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:42.212628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:42.213124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:42.213606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:42.214977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b, user.id=3d5131428f7c439c90a6d356aaf355ba) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:42.215532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:42.218291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c09514-ab69-4a39-b4f2-a98fa6e7982a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:42.235070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 104/208] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/role_assignments?user.id=3d5131428f7c439c90a6d356aaf355ba&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=948e35a24a684b48b4ce539aae40b004 => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:42.544282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566590a-26b5-430f-a8b2-51957e1f743c None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:42.544550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566590a-26b5-430f-a8b2-51957e1f743c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:42.544987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566590a-26b5-430f-a8b2-51957e1f743c None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:42.546400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 105/209] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:42.553471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce7e5-b0fc-42df-a350-3607ecd86963 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:42.553872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce7e5-b0fc-42df-a350-3607ecd86963 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:42.554123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ce7e5-b0fc-42df-a350-3607ecd86963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:42.578671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-903ce7e5-b0fc-42df-a350-3607ecd86963 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:42.580496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-903ce7e5-b0fc-42df-a350-3607ecd86963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:42.585419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:42.693045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 105/210] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:42.911941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe9b3-926f-4909-bb52-2a0f0185abed None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:42.912352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe9b3-926f-4909-bb52-2a0f0185abed None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:42.912919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbe9b3-926f-4909-bb52-2a0f0185abed None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:42.915723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 106/211] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:42.922228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:42.922714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:42.923202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:42.958808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:42.960089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:43.057604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 106/212] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:43.149021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe9b3-926f-4909-bb52-2a0f0185abed None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:43.167667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:43.266236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbe9b3-926f-4909-bb52-2a0f0185abed None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:43.312384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:43.313055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.313345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.313681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.314789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:43.317750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:43.319481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 107/213] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:43.325376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:43.336235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:43.434455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:43.441501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:43.463444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0d769-a0e7-4b7e-9a0c-3f16965b1eee None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:43.488821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119b4ea-d045-497b-b9b1-7599198826b3 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:43.502340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:43.502981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.503444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.504141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.516583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:43.522803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:43.523742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:43.524537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 108/214] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:43.529643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:43.546199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:43.547443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.548440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.549266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.551061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:43.553235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ebcf1-eba1-44eb-9488-fe075e1fc01f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:43.590478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 107/215] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:43 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:43.681527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edf8e2-6583-4171-9f52-b2f7bcf373b1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:43.725501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:43.726628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.727144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.727657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.728624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:43.729181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:43.730904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:43.736357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390e1e-4765-4700-a439-f11e829ff05c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.737333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390e1e-4765-4700-a439-f11e829ff05c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.738470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49390e1e-4765-4700-a439-f11e829ff05c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.741042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 108/216] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:43.747358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 109/217] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:43.749094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbe4c-ce01-4896-a47f-78a4d34fd263 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.749381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbe4c-ce01-4896-a47f-78a4d34fd263 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.749656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bbe4c-ce01-4896-a47f-78a4d34fd263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.752886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:43.757701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:43.781928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fa7bbe4c-ce01-4896-a47f-78a4d34fd263 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:43.783376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fa7bbe4c-ce01-4896-a47f-78a4d34fd263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:43.886544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 109/218] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:43.886544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129504f6-e3f3-4d98-a1cb-63ff0c169d9f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.886941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129504f6-e3f3-4d98-a1cb-63ff0c169d9f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.887107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129504f6-e3f3-4d98-a1cb-63ff0c169d9f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.888601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 110/219] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:43.895274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.895729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.896085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.916360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:43.917610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:43.922709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a84d5d-80be-4f99-80c7-d450a2187edc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:43.979829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:43.981962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:43.982788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:43.983518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] PATH_INFO: `/v3/users/1ba88070d4904c57920997018c3d653a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:43.993008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.010236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba88070d4904c57920997018c3d653a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.012250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.019767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 110/220] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:43 2022] GET /identity/v3/users/1ba88070d4904c57920997018c3d653a => generated 297 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:44.020920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 111/221] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:44.021199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.105737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.151531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79f4d2-0144-4eee-92cb-50a2714c05e8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.183956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.199650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.200698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.201004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.201282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.309531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.310472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cd7c2-dd45-4ce3-ab3e-6cdff8d4abd7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.312137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.356315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.356999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.357265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.357540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.370204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:44.375092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:44.376482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:44.377876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 112/222] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:44.382255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.433622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.446645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.510637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 111/223] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:44.511688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.539607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37886d9-2d1a-46bf-a376-6b08915c0252 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.589818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.591034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.592411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.592968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.593859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:44.594365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.596270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.610195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 113/224] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:44.610755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.645088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3d0b0-b794-4e20-a51a-c174ba4d23bc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.706750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.707815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.708299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.708846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.722524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:44.729511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:44.730458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:44.731241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:44.734334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 112/225] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:44.735361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.769690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.775408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c9e0-67a0-42ef-b7c2-c2227fa2e0ff None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.786711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.821405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.822318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.822659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.823335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.824917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.826950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.829441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 114/226] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:44.830128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.876223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495ca2c-1a6e-4591-8dc6-0ac37c93e02c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.913542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.914549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.915049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.915508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.916882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.918621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.920491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 113/227] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:44.921607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.974397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd0f2e-1d77-426d-875e-f5e485cc14f8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.028642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.037063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.037701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.037983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.038261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.038951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:45.039259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.040672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.051013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af15d57-86b8-4340-a98f-c1950178d4f8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.053955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 115/228] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.055127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.101800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.117615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.119747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.120847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.121873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.124450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=1ba88070d4904c57920997018c3d653a) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:45.125561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.131091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.145887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 114/229] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/role_assignments?user.id=1ba88070d4904c57920997018c3d653a&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=2db6f108db484377bb8284827c2bc59c => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.148324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.246107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957be5d-b7af-4164-b563-1eb4ead6b77d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.356194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.356999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.357345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.357688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.361619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.363909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.366027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 116/230] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.368678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e114663-fb0d-4b6d-aec0-0107b364b779 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.371838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.459815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.461982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.462570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.463142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.466356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.469583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.471500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 115/231] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.478512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.573209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.601503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7786456-3874-4e15-9f11-0607eb803f32 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.645581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.646698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.646830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae01866-624b-498e-8e26-e9384f447175 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.647315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.647779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.649741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.651451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.653614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 116/232] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:45.661921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.664710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.747620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.748652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.749234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.749716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/28670002ab2d445984fd8811844edac1/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.755174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, user_id=28670002ab2d445984fd8811844edac1, role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.757002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc7f1a-15f5-4698-ad32-2c2ab624e65a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.781840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 117/233] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:45 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/28670002ab2d445984fd8811844edac1/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:45.833520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.853086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51945d-aad8-4a7f-b8ef-5db7c5765c2b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.911711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.912399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.912681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.912983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/28670002ab2d445984fd8811844edac1/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.914974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, user_id=28670002ab2d445984fd8811844edac1, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.916447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84f438-d9d0-45a2-9a50-00ade57451d7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.950363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 117/234] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:45 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/28670002ab2d445984fd8811844edac1/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:46.246569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cc5d-cef5-41b5-9a45-24c1e367f53f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.246962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cc5d-cef5-41b5-9a45-24c1e367f53f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.247157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5cc5d-cef5-41b5-9a45-24c1e367f53f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.248754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 118/235] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:46.255027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.255505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.255600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.276322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:46.277536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:46.344914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685703c-fd24-405e-b4be-a5ebfb9c417a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.344914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685703c-fd24-405e-b4be-a5ebfb9c417a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.344914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685703c-fd24-405e-b4be-a5ebfb9c417a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.345817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 119/236] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:46.352847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.353474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.353948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.376698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:46.380553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:46.401359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 118/237] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:46.487313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:46.805300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:46.871165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:46.961557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:46.998921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9ebbe-3cdc-4f40-8587-5d7b590f2127 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.054663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.055386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.055611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.055887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.080895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:47.086272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:47.087214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:47.087993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 119/239] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:47.094355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:47.134261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:47.151861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b79bcc-8dbc-4626-b715-5dec250f1194 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.234129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.234806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.235087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.235360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.239244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:47.240759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:47.242541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 121/240] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:47.249396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:47.311151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dfc44-9b46-4cca-bc6a-bd8ac209d082 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.395853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.399343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.399343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.399343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.399343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:47.399343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:47.400102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:47.410646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 120/241] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:47.417536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:47.422137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:47.469677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271f511-eee1-4fe0-b5a5-c3b5c491b41e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.540868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.541635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.541998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.542373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.543383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:47.546079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:47.587727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 122/242] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:47 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:47.646972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b100f-1798-4fdd-9670-31f51f1b0c54 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.700217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.700978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.701318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.701597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] PATH_INFO: `/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.719788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] RBAC: Authorizing `identity:get_user(user_id=8cd9176ab2854f808f4b2db4d2f7bffd)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:47.721532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b6420-9ea1-4283-ba6f-e587a86a43ea None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:47.727357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 121/243] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:47 2022] GET /identity/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:47.730139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:47.782847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:47.866307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080822-30c1-4857-9c5a-e15e04c782cc None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.866614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080822-30c1-4857-9c5a-e15e04c782cc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.866913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080822-30c1-4857-9c5a-e15e04c782cc None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.871346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 122/244] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:47.876315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.876614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.876936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.896767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacb8d0-af86-4f20-90ba-f76f72e9a768 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:47.901193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:47.902507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:47.941467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:47.942257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.942547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.943451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.002932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.023883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 123/245] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:48.049642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.051421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.093243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.188054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 123/246] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:48.189594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.346134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b14d5-8ed5-4b5e-85e9-195a6102c496 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.397430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.398099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.398377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.398650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.399870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.401426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.403250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 124/247] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:48.405116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.409532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.493753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.539597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8af28-3c72-419a-a7a9-9c9d22591c90 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.565223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4883d-df81-415c-8990-16b92b699802 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.581018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.582130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.582477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.582753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.583628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=8cd9176ab2854f808f4b2db4d2f7bffd) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:48.583994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.585603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23ce4-6d6e-4a28-86bd-50972f8d2183 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.592032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.592204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 125/248] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/role_assignments?user.id=8cd9176ab2854f808f4b2db4d2f7bffd&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=948e35a24a684b48b4ce539aae40b004 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:48.598727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedf00-d864-4919-93e3-3758bd222d8c None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.598922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedf00-d864-4919-93e3-3758bd222d8c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.599193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dedf00-d864-4919-93e3-3758bd222d8c None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.600928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 126/249] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:48.602103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e45e5-527f-4fc5-8bc0-ddac5cb9d4b4 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.602388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e45e5-527f-4fc5-8bc0-ddac5cb9d4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.602659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e45e5-527f-4fc5-8bc0-ddac5cb9d4b4 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.604133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 127/250] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:48.612296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.613247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.613590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.614782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.615671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.616239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.616715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.647130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:48.656221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:48.657882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8cc709a0-d773-4d4e-915e-1ce7bedba76b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:48.660110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:48.661406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:48.662212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:48.667974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 124/251] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:48.670072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.675066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.675704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.713413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:48.716864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:48.822697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 128/252] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:48.823564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.841425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 125/253] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:48.932532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.020074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab844115-e9f7-427b-941c-ce035f185f9e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.074101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.074640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.074924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.075194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.075869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.076171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.077601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.089608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 129/254] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.095053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.246646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712616-5534-4e1f-ba58-a0dab17eca27 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.259636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.293631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.294636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.295141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.295605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] PATH_INFO: `/v3/users/1ba88070d4904c57920997018c3d653a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.297025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] RBAC: Authorizing `identity:get_user(user_id=1ba88070d4904c57920997018c3d653a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.298692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.301200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 126/255] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/users/1ba88070d4904c57920997018c3d653a => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.304589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.307364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.429754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec49e0-671c-45c7-ab58-1219edf8ece6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.444657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12d4f5-405e-4e5d-bc33-2cb0e01a8aec None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.447203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.478655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.479349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.479630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.479903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.502578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:49.516671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.517641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:49.518430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:49.519023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 130/256] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.524153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.531210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.531873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.532155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.532434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.533616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.535575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.545028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 127/257] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.545907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.639201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.690594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9c58d-54c9-43e2-a4ef-893168ec5eec None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.731789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.732439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.732720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.733043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.746955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:49.752025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.754392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 131/258] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.756337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.771457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00349-20da-44cb-9db4-b19bd2eb04fc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.796145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.863197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.864271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.864769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.865281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.866205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.866758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.876865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.885657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deab8-97e3-4183-9117-82c2e92e7da6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.892969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 128/259] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.894428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.934804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.935485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.935768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.936041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/1ba88070d4904c57920997018c3d653a/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.938239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, user_id=1ba88070d4904c57920997018c3d653a, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.944929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.960390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 132/260] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:49 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/1ba88070d4904c57920997018c3d653a/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:49.961305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.089093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.099942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f83b7-dac9-495a-bc7b-a7779f8a1969 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.146683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b512c2c-dcf3-453c-b67b-c8ea3cc904d0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.151956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.152683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.153005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.153284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.154782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.156518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.159201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 133/261] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.171177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.174737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.234277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.235755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.236042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.236319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.237054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.237455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.239381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.254493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 129/262] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.260256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.334200 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9810c27-52b6-44b6-b605-cb9c301c70ca None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.380867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.380867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.380867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.380867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.414739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.463443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.464978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.563141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863f4e9-abae-435a-be43-5c6b2a5765e8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.585427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 134/263] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:50.591610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.650960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.651784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.652167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.652564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] PATH_INFO: `/v3/users/28670002ab2d445984fd8811844edac1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.656281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] RBAC: Authorizing `identity:get_user(user_id=28670002ab2d445984fd8811844edac1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.657915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.660767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 130/264] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/users/28670002ab2d445984fd8811844edac1 => generated 283 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:50.666129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.666468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.711007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e74b60-4b88-4cd8-852b-db46b6724503 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.753456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.754740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.755290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.755713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.757563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.759662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.762117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 135/265] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:50.766377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.772442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.879276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91493b-d95e-4b10-96f4-b2ea60690802 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.894402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68de02-90ef-41ff-8582-95bc4e50a399 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.940411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.941404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.941836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.942408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.951469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.972628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.973773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.973773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.974009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.974750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=28670002ab2d445984fd8811844edac1) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.975145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.976557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c2e9-0485-4f3d-b6b8-25e6ceb99ea5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.986512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 136/266] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/role_assignments?user.id=28670002ab2d445984fd8811844edac1&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.022293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfe722-cad4-4e90-9a6b-25965a6524a1 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.022622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfe722-cad4-4e90-9a6b-25965a6524a1 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.022880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfe722-cad4-4e90-9a6b-25965a6524a1 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.024567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 137/267] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:51.030441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.030774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.031013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.062975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:51.064313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:51.123326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.124911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33630-486c-409d-a9cd-6459ab38ad1f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.229279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.232291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 138/268] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:51.345511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 131/269] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:51.352175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.352707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ccff-9b52-4516-aac0-87db42360823 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.353026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ccff-9b52-4516-aac0-87db42360823 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.353300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527ccff-9b52-4516-aac0-87db42360823 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.354651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 132/270] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:51.365781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf104-8a0d-4cd3-b9f0-a3d39427fc0b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.366095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf104-8a0d-4cd3-b9f0-a3d39427fc0b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.366338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3daf104-8a0d-4cd3-b9f0-a3d39427fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.409973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a3daf104-8a0d-4cd3-b9f0-a3d39427fc0b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:51.411196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a3daf104-8a0d-4cd3-b9f0-a3d39427fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:51.479865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56eed-8803-44d7-9536-6d5c1ce5043d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.512966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.524031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.525175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.525658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.526128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.527564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.529324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.531848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 139/271] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.540870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.587890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 133/272] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:51.606611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c129e9-faaa-495a-8295-a4f47c80defc None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.607305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c129e9-faaa-495a-8295-a4f47c80defc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.607779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c129e9-faaa-495a-8295-a4f47c80defc None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.609479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 134/273] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:51.618449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.619069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.619542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.649639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:51.651766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:51.717254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8170a6-1e19-41fb-95e0-ad70c52c1d96 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.758195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.759249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.759756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.760322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.761292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=28670002ab2d445984fd8811844edac1) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.761807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.763468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.771761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 140/274] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/role_assignments?user.id=28670002ab2d445984fd8811844edac1&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.772947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.785741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.797067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 135/275] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:51.850428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.925968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9adb54-6e64-4afc-9813-493a94269780 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.952247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.972644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.973841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.974309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.974762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.976162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.977829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.980053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 141/276] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.989716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.133827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f9353-7e43-492a-9dde-c2e0e7905fb9 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.185283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.185944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.186224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.186500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.201955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:52.208342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.209625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:52.210585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:52.211573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 136/277] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.212422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.220719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c9f8d-e64a-4d5d-8ad9-6b1779754f26 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.251525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.270256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.270895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.271179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.271457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.272130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.273656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.297731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 142/278] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:51 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:52.304932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.315991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.391442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b6152-6718-4a58-b047-8d927ac842b0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.449815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.450529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.450815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.451096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.466124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9f21-b023-41b2-9262-3c6a52be9f18 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.466717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:52.474202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.475232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:52.476037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 137/279] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.482177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.517972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.519212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.519649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.520162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.520910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.521222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.522700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.533846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 143/280] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.541044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.605209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.629169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516329b-a9b4-4300-b349-ca4bf7a924e4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.657282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.680410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.681086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.681388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.681639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.682327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.682632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.684277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.692659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f95761-2f61-4b56-ac78-b47da648cb50 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.695383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 138/281] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.703019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.744850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.744850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.744850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.744850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] PATH_INFO: `/v3/users/790305db294b453ba8930b38e4b5795a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.760420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] RBAC: Authorizing `identity:get_user(user_id=790305db294b453ba8930b38e4b5795a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.762618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c887e-209d-433b-8008-f357016f71d4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.765585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 144/282] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/users/790305db294b453ba8930b38e4b5795a => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:52.766757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03c36-1300-4a7b-8b6f-f59c22dd77b7 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.767031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03c36-1300-4a7b-8b6f-f59c22dd77b7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.767303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a03c36-1300-4a7b-8b6f-f59c22dd77b7 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.771832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 145/283] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:52.773809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03c36-1300-4a7b-8b6f-f59c22dd77b7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.871454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55495feb-88f6-41e8-9cb3-e9f3bd35fc97 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.894887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.900115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a03c36-1300-4a7b-8b6f-f59c22dd77b7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.935638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.936605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.937361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.937962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] PATH_INFO: `/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.940089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.940230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd9176ab2854f808f4b2db4d2f7bffd)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.941061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.941640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.942281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.943154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, user.id=790305db294b453ba8930b38e4b5795a, scope.system=all) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.943559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.944020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34204d9-a0ec-414a-930f-7d354c1d3045 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.945302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.953037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 139/285] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.955579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.956198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.956980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 146/285] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/role_assignments?user.id=790305db294b453ba8930b38e4b5795a&scope.system=all&role.id=2db6f108db484377bb8284827c2bc59c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:52.957626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.965935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.995581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:52.997866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:53.112136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:53.149759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 140/286] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:53.211805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5708acf-250b-4e54-902d-31b4a56c36d7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:53.258308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:53.258960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:53.259266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:53.259539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:53.260697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:53.262201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:53.263876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 147/287] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:53.270414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:53.432749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c35838-2aec-4513-9158-41502f26d5aa None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:53.444234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:53.484911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:53.485954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:53.486575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:53.487086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/8cd9176ab2854f808f4b2db4d2f7bffd/roles/948e35a24a684b48b4ce539aae40b004` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:53.490134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, user_id=8cd9176ab2854f808f4b2db4d2f7bffd, role_id=948e35a24a684b48b4ce539aae40b004)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:53.492236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:53.509303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:53.516758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 141/288] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:53 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/users/8cd9176ab2854f808f4b2db4d2f7bffd/roles/948e35a24a684b48b4ce539aae40b004 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:07:53.600941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f2f1e-11c3-47e5-a864-3c78e4856ba1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:53.642573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:53.643699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:53.644208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:53.644668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:53.657155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:53.663014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:53.663970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:53.664756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:53.672133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 148/289] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:53.673821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:53.729333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:53.820088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ba9e9-4581-4e03-8ac8-4a590f3043e7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:53.862919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:53.863623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:53.863910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:53.864176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:53.865171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:53.865656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:53.868299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:53.879533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 142/290] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:53.885123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.035888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.052771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22143de-cdcf-4ead-9a1e-668f100433a6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.106373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.107343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.107805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.108264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] PATH_INFO: `/v3/users/1ba88070d4904c57920997018c3d653a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.110341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba88070d4904c57920997018c3d653a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:54.114242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:54.117934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 149/291] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:53 2022] GET /identity/v3/users/1ba88070d4904c57920997018c3d653a => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:54.127833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.270843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.274680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c855530-8160-4233-b358-e55b866ae2da None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.314354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.314987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.315291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.316098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.395443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:54.397136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:54.539118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.543269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 143/292] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:54.550709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.743825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12e911-518c-445d-9f30-9999908c6331 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.788574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.789256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.789538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.789818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.791018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:54.792497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722b62f-44cd-47a6-a332-3e5592f45470 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:54.794519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 150/293] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:54.802445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.975142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d73d7a-ef7c-4ba8-a6d5-4d60616ed199 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.051132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.052132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.052602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.053101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.054054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=1ba88070d4904c57920997018c3d653a) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:55.054555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.056234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90818d54-8c59-4811-bbe0-2fd1a46129b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.066315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 144/294] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/role_assignments?user.id=1ba88070d4904c57920997018c3d653a&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=2db6f108db484377bb8284827c2bc59c => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:55.344883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093f67-90ee-4413-a268-832ce42153ea None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.345070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093f67-90ee-4413-a268-832ce42153ea None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.345353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd093f67-90ee-4413-a268-832ce42153ea None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.347602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 151/295] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:55.353725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.354039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.354269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.378475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:55.379730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:55.401739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5508c6-29fb-4cf0-914a-9f7c674ff898 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.402042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5508c6-29fb-4cf0-914a-9f7c674ff898 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.402281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5508c6-29fb-4cf0-914a-9f7c674ff898 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.403917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 152/296] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:55.421300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.421800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.422316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.445903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:55.448321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:55.467045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.480876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 145/297] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:55.482495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.539498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 153/298] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:55.848795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.869532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.999344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965374-02d8-485c-acbd-4ef08039cc87 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.039985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.040648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.041000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.041311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.042557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.044027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45740b-a4da-4be3-93aa-d8ddee19d37b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.045826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 146/299] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.047833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709bd-0f2c-4ce1-8060-e960aab2a1bb None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.048332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709bd-0f2c-4ce1-8060-e960aab2a1bb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.048801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c709bd-0f2c-4ce1-8060-e960aab2a1bb None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.052888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 147/300] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:56.054010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289374-12e1-49a1-9287-a9656d1dfdf7 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.054494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289374-12e1-49a1-9287-a9656d1dfdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.055071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70289374-12e1-49a1-9287-a9656d1dfdf7 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.056673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 148/301] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:56.057803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70289374-12e1-49a1-9287-a9656d1dfdf7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.076230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d9124-1fa2-4b11-9ef5-80dfcc3ce3f6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.119603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.120353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.120719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.121129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.133989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:56.135072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5af64005-1867-49df-a3ba-94d5866fbda6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:56.141156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.142482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:56.144299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 154/302] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.145534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4631df-6e16-4f3f-a7c6-abde97c7d885 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.145945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4631df-6e16-4f3f-a7c6-abde97c7d885 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.146339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4631df-6e16-4f3f-a7c6-abde97c7d885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.169634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fd4631df-6e16-4f3f-a7c6-abde97c7d885 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:56.170832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fd4631df-6e16-4f3f-a7c6-abde97c7d885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:56.187783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70289374-12e1-49a1-9287-a9656d1dfdf7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.188043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.230786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.231544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.231870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.232269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] PATH_INFO: `/v3/groups` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.233024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.234659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.257857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 155/303] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:56.258844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 149/304] 10.222.0.69 () {60 vars in 1134 bytes} [Tue Aug 23 22:07:56 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:56.259529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.259740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.260119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.260455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.291839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:56.293806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:56.408927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 156/305] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:56.453434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcae27-ca49-429d-b095-b015086a87ec None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.486724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.507602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.508773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.509432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.510119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.511020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.511391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.512852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.527298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 150/306] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.534870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.579616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.667262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.708107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9134b2-a407-4222-98f0-076618f492ba None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.729672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568977-dda7-4347-8266-52731a3e1cbc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.764538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.765485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.765485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.765931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] PATH_INFO: `/v3/users/e79f83e75f1e4e799966c6a6c39c9f70` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.790323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] RBAC: Authorizing `identity:get_user(user_id=e79f83e75f1e4e799966c6a6c39c9f70)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.792459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.797132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 157/307] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/users/e79f83e75f1e4e799966c6a6c39c9f70 => generated 293 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.797132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.806332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.807338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.807629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.811053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.826882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:56.833870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.834840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:56.835749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:07:56.840045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 151/308] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.840937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.913082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.965321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bfa9b-e35a-4cdc-851f-c025790ae979 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.990565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf4ce8-3c47-4b8b-b6a8-4fc538334665 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.021367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.022275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.022741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.023370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.027766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.043451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.044300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.044759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.045300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.045944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:57.046581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, user.id=e79f83e75f1e4e799966c6a6c39c9f70, scope.system=all) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.047098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.049759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:57.055851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:57.057544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:57.059086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:07:57.060885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 152/309] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/role_assignments?user.id=e79f83e75f1e4e799966c6a6c39c9f70&scope.system=all&role.id=948e35a24a684b48b4ce539aae40b004 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.060885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.062410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 158/310] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:57.068984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.236129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d8b1-0a9d-4fac-8ed2-aa1e3cccb607 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.245963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b80e1d-19f9-4d4b-8292-b124dcf99fd3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.252307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.285887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.286502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.286816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.287031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.287699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.287856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.288009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.288690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.289093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.289415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.289516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.290249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.290617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.292120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.302134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 159/311] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:57.310792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 153/312] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.314219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.320606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.433269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.446244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cae36-ec2c-4a2c-830e-7785b90c21b1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.454398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0d1b-4946-4704-95b6-705145714196 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.486340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.487065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.487960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.488330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] PATH_INFO: `/v3/users/790305db294b453ba8930b38e4b5795a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.489905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] RBAC: Authorizing `identity:get_user(user_id=790305db294b453ba8930b38e4b5795a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.491613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.494001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 154/313] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users/790305db294b453ba8930b38e4b5795a => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.499307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.500021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.500300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.500461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.500595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] PATH_INFO: `/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.501774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] RBAC: Authorizing `identity:get_user(user_id=8cd9176ab2854f808f4b2db4d2f7bffd)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.503801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.506101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 160/314] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users/8cd9176ab2854f808f4b2db4d2f7bffd => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:57.514752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.568218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.666646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d22fb8-53a2-4dd3-aff4-69fcc9e5da5d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.670594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402029f-2972-4bf5-87eb-7e9deb20e498 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.704961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.718406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.719031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.719351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.719623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.735912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.736659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.736884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.737682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] PATH_INFO: `/v3/system/users/790305db294b453ba8930b38e4b5795a/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.739506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=790305db294b453ba8930b38e4b5795a, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.740930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.757210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 155/315] 10.222.0.69 () {58 vars in 1334 bytes} [Tue Aug 23 22:07:57 2022] PUT /identity/v3/system/users/790305db294b453ba8930b38e4b5795a/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:57.836927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.838702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.012323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 161/316] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:58.022662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.189461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa303d6-9388-4281-adb7-d7d7dc08bc06 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.193316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.234793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.235752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.236039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.236314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.238212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.240513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede66f1-8374-4f43-aaa2-9f7386daf24e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.243017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 156/317] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.250129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.286389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.384880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cba758-f3f4-4725-b3a4-a7a699d8bb7b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.440137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.440945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.441429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.441855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.442625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20, user.id=8cd9176ab2854f808f4b2db4d2f7bffd) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:58.443232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.444735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799538b9-c3da-4165-b4ed-02de6fb3976a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.454385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 162/318] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/role_assignments?user.id=8cd9176ab2854f808f4b2db4d2f7bffd&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=948e35a24a684b48b4ce539aae40b004 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.490206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a87c7-9ee3-47b1-8df0-94030e5a0265 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.490537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a87c7-9ee3-47b1-8df0-94030e5a0265 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.490771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a87c7-9ee3-47b1-8df0-94030e5a0265 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.492551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 157/319] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:58.498556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.498881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.499434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.526010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:58.527377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:58.656905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 163/320] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:58.965437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a87c7-9ee3-47b1-8df0-94030e5a0265 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:59.135922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a87c7-9ee3-47b1-8df0-94030e5a0265 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:59.193145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:59.193732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.194016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.194292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.195947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:59.198038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f54f7-594a-45f1-a576-8087cb8c7616 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:59.200918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 158/321] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:59.207794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:59.249413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:59.367768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcf02-fdfc-4aff-9f7a-fea6800af0db None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcf02-fdfc-4aff-9f7a-fea6800af0db None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.368295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fcf02-fdfc-4aff-9f7a-fea6800af0db None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.369967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 159/322] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:59.375483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed4-6bba-4175-941b-f51576be513f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.375772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed4-6bba-4175-941b-f51576be513f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.376035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b9ed4-6bba-4175-941b-f51576be513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.392187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b0b2d-4d3e-47fc-a17a-e61d8f96fc37 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:59.402094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a24b9ed4-6bba-4175-941b-f51576be513f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:59.404003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a24b9ed4-6bba-4175-941b-f51576be513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:59.453199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:59.454302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.454680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.454969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] PATH_INFO: `/v3/groups` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.456332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:59.458357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:59.461385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:59.487985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 164/323] 10.222.0.69 () {60 vars in 1134 bytes} [Tue Aug 23 22:07:59 2022] POST /identity/v3/groups => generated 226 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:59.523058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 160/324] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:00.036422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.182168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.207095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a700e-53de-4972-8fe9-9ade0e3e8148 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.208217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a700e-53de-4972-8fe9-9ade0e3e8148 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.208707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a700e-53de-4972-8fe9-9ade0e3e8148 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.210663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 161/325] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:00.218236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.218846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.219366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.222050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc21adb-8393-459b-bdb9-a715c66c81cd None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.244727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:00.246623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:00.289324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.290292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.290768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.291233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.312437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:00.324154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:00.325676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:00.326941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 165/326] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:00.335538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.353320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 162/327] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:00.538539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607248-3bb5-4da5-8d8b-e1460609edf8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.605930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.606875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.607363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.607852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.609112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:00.609657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.612872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.630605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 166/328] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:00.637374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.698429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.702178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.870205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9045f-8f34-4398-a41c-c0b8036a3621 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.885504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.895355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4a7c2-ff07-465c-af3b-550d9c77777b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.914505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.915154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.915480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.915721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.938980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:00.946214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:00.947922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:00.949315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 167/329] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:00.954621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.984127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.984788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.985100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.985374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] PATH_INFO: `/v3/users/e79f83e75f1e4e799966c6a6c39c9f70` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.986694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] RBAC: Authorizing `identity:get_user(user_id=e79f83e75f1e4e799966c6a6c39c9f70)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.988848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.990538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 163/330] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/users/e79f83e75f1e4e799966c6a6c39c9f70 => generated 293 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:01.001392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.125296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.226861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6391-8f36-4b1f-ad5d-1319440a1b7a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.242312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf05d7-5766-4514-bda9-a0bf6ee9770e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.277969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.278642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.278916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.279184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] PATH_INFO: `/v3/system/users/e79f83e75f1e4e799966c6a6c39c9f70/roles/948e35a24a684b48b4ce539aae40b004` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.280847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e79f83e75f1e4e799966c6a6c39c9f70, role_id=948e35a24a684b48b4ce539aae40b004)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.282266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.302994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 164/331] 10.222.0.69 () {58 vars in 1334 bytes} [Tue Aug 23 22:08:01 2022] PUT /identity/v3/system/users/e79f83e75f1e4e799966c6a6c39c9f70/roles/948e35a24a684b48b4ce539aae40b004 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:01.315076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.316239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.316520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.316793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.317524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:01.317827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.319266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.330059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 168/332] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:01.336699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.378151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.474098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d3700-dd1a-445c-a431-6269da01d428 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.525726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.526388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.526651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.526924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] PATH_INFO: `/v3/users/790305db294b453ba8930b38e4b5795a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.528123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] RBAC: Authorizing `identity:get_user(user_id=790305db294b453ba8930b38e4b5795a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.529715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f72e0-e948-4295-8e7f-8b6e0e4fa29e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.531731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 165/333] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/users/790305db294b453ba8930b38e4b5795a => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:01.538568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.670697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697a3a8-152f-484e-8d3c-1dac23ef1c3a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.733412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.755601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.756563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.757053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.757531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.758900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] RBAC: Adding query filter params (role.id=2db6f108db484377bb8284827c2bc59c, user.id=790305db294b453ba8930b38e4b5795a, scope.system=all) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:01.759430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.762137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37e99-5491-49db-84ee-99e77e73677a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.792651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 169/334] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/role_assignments?user.id=790305db294b453ba8930b38e4b5795a&scope.system=all&role.id=2db6f108db484377bb8284827c2bc59c => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:03.646931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237387e4-b2c9-400a-9bba-fb3e2e147b3e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.647501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237387e4-b2c9-400a-9bba-fb3e2e147b3e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.647725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237387e4-b2c9-400a-9bba-fb3e2e147b3e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.650196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 166/335] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:03.658401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c1bf-1c02-42ab-aea5-d79d4e38b33c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.659733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c1bf-1c02-42ab-aea5-d79d4e38b33c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.659733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c1bf-1c02-42ab-aea5-d79d4e38b33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.689428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8551c1bf-1c02-42ab-aea5-d79d4e38b33c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:03.690904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8551c1bf-1c02-42ab-aea5-d79d4e38b33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:03.793891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 170/336] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:03.990175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37e95-0ad3-40c8-bea6-60cad10a4180 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.990876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37e95-0ad3-40c8-bea6-60cad10a4180 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.991375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37e95-0ad3-40c8-bea6-60cad10a4180 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.993392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 167/337] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:03.999309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.999588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.999853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.025539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:04.026882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:04.118463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 171/338] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:04.291747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff37e95-0ad3-40c8-bea6-60cad10a4180 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.507608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.520772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff37e95-0ad3-40c8-bea6-60cad10a4180 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.562089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.616907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.617575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.617854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.618124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.642735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:04.653428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:04.661657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:04.664026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:04.666292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 168/339] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:04.671345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.850142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e458-a770-449d-921e-ff1336f77e76 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.882747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27182-8983-45af-a4c4-196b58cc5d89 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.967513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.968740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.969300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.969794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.971059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.972523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.973295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.973441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.973656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.973935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.976043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.994767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 169/340] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.003688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:05.005024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:05.008800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:05.009737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:05.010528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 172/341] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:05.059587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.062118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.224414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291baf75-3576-413e-bd27-0c5977c5af7b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.293304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.294248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.294671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.295092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.333735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c46c8-b0a8-4f0c-ba92-2bc1e8211de0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.338321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.436908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.439568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384ebb-4306-476a-aa2b-a9a4282c99c5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.466273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.467328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.467848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.468333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.469320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:05.469870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.471577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae45354-dce3-4210-b5ab-f2a67dbaa693 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.480170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.482748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 173/342] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.484535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717903-5974-45ba-9520-79be64dc65f0 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.485099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717903-5974-45ba-9520-79be64dc65f0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.485596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c717903-5974-45ba-9520-79be64dc65f0 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.488170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 174/343] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:05.490423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b416-f1f1-4488-8865-85564cef9413 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.490952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b416-f1f1-4488-8865-85564cef9413 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.491448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6b416-f1f1-4488-8865-85564cef9413 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.493088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 175/344] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:05.498120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.498762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.499240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.522895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:05.524483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:05.606037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 176/345] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:05.607498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.653214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 170/346] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:05.654709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.655135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.655434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.679644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:05.681053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:05.738154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.745562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad785fa7-d35a-4b18-aaac-4fd3dee31c4e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.779848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 171/347] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:05.785076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.806255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.807288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.807780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.808258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.843782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.904491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaefca-3e5b-4835-b0ae-d73cec1a91f6 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.916088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.922509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9448-0d6c-41c0-bdf1-d7f40e002461 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.946811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.947457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.947729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.948016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.949204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.950673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.952479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 172/348] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.959528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.082369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2f287-ff77-48aa-9f52-e0a117fb3498 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.086450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.096041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 177/349] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:06.096041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4de75-f60a-42cc-885e-acda1b984c77 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.096041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4de75-f60a-42cc-885e-acda1b984c77 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.097037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4de75-f60a-42cc-885e-acda1b984c77 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.098683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 178/350] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:06.106795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.107133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.107350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.108625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.134033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.135006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.135006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.135278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.142279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.143813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.146000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 173/351] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.146835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.147063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:06.148298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:06.265916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05964369-b73b-4b00-8fbe-6f981dd5d0ed None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.316493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.317630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.318135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.318629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.326113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.328523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.332140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 174/352] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.333793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.345819 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 179/353] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:06.349157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.477705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143dfa7-cafc-48bc-bb53-a52fa317dbb2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.508320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.522977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.524103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.524389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.524661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.526195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.528138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.530137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 180/354] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.530949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.534540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.626556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3b206-66ea-4c09-beb9-1edaaa4a4178 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.668360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980e44e-b9c7-40e7-b9ec-f37e49ec153f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.687553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.688686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.689094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.689584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.691034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:06.691701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.693857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.704713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 175/355] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 260 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.706451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.717949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.718691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.718975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.719250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.734065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:06.740153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:06.741204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:06.742048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:06.746696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 181/356] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:06.746696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.858796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.935630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7d6c6-feb4-43d7-bbbd-33166e099cab None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.949637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ee64d-055f-4b70-94f8-081ad9eb6767 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.965850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.014939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.016348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.016786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.017276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.041533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:07.042767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.043400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.043680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.044121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.044987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.045299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.046777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e7e4285b-f56d-4d6e-a68e-9faf257d8d2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:07.053253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:07.054881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:08:07.056331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:07.059494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 176/357] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:07.061862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc0d-2a72-48fb-8650-4e11bb3fedb0 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.062530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc0d-2a72-48fb-8650-4e11bb3fedb0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.063018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23edc0d-2a72-48fb-8650-4e11bb3fedb0 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.065939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 177/358] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:07.069123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 182/359] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=2db6f108db484377bb8284827c2bc59c => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:07.069123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.070427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23edc0d-2a72-48fb-8650-4e11bb3fedb0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.286670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d864c1e-3932-44f5-bf75-e7a7df32b082 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.294886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23edc0d-2a72-48fb-8650-4e11bb3fedb0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.319008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.357851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.358902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.359381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.359851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.361544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.363495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.363968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.364444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.365799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.366206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.368742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559eb52c-21d6-4f13-be01-a951d245c483 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.374873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:07.382703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:07.383647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:07.384525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:07.386093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 178/360] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:07.387473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 183/361] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:07.388337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.388753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.388878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.389325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.422852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:07.425396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:07.477161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.553880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 179/362] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:07.555000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.610196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5f8b7-f6cb-4933-897f-6df13881a36e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.718843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.719469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.719751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.720028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.720703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.721036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.723406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.751118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 184/363] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:07.751991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.803449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe8e53-2c65-4b7b-bf55-7f8968e21e86 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.859700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.886456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.887790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.888520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.889056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.965966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.992921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b628d2e-7721-458a-931a-4b2758267266 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.020067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.020067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.045414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.046444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.046931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.047399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.048269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.048769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.050942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.065534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 185/364] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.070167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.155170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 180/365] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:08.155944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.194722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.198036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d74af3-3603-4d1b-be51-f5c04012e209 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.235957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.237737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.238225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.238721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] PATH_INFO: `/v3/users/e79f83e75f1e4e799966c6a6c39c9f70` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.240123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] RBAC: Authorizing `identity:get_user(user_id=e79f83e75f1e4e799966c6a6c39c9f70)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.241883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.243797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 186/366] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/users/e79f83e75f1e4e799966c6a6c39c9f70 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.244953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.261316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.291537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f655b0-c970-47e9-8fad-ba839014c8c3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.363197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.364224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.364687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.364995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155834e8-178a-44f4-90c3-68be1b1675ab None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.365184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.450498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.452005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.452797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.453570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.474187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:08.485107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:08.486879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:08.488933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:08.493616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 187/367] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:08.495474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.501346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.504340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.551072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.624264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.667505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 181/368] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:08.668460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.710872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea50e6-701d-48a4-acee-e9e6a926c196 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.790958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bddccd-efb1-4162-9442-777be2a9f6c1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.791869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.792998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.793479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.793965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.797999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.800753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.812467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 188/369] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.814007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.834116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.834793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.835016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.835291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.836046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] RBAC: Adding query filter params (role.id=948e35a24a684b48b4ce539aae40b004, user.id=e79f83e75f1e4e799966c6a6c39c9f70, scope.system=all) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.836390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.837982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.852881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 182/370] 10.222.0.69 () {56 vars in 1308 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/role_assignments?user.id=e79f83e75f1e4e799966c6a6c39c9f70&scope.system=all&role.id=948e35a24a684b48b4ce539aae40b004 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.853546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.890742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.047531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727328-fefb-417e-81ae-33c5a872eaab None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.117570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.135228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d0b18-1928-47de-8f50-bc1280c263ca None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.136275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.137407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.137901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.138384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.144109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.148239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.154115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 183/371] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:09.158533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:09.213139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.214157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.214615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.215084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.215936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:09.216618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.218689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.232203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 189/372] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:09.233785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:09.352020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.367217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ca1a3-887d-40fc-99fb-f3f1657a301b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.413751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264bbc3-470e-43b0-8773-384c905273b0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.414850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.416923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.416923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.416923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.418874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.419486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.424863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 184/373] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:09 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:09.424863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:09.473885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.474523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.474813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.475163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.476353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.478718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.483081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 190/374] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:09 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:09.483081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:09.529430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.634891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72336132-f596-4317-8176-cb60bc75bea1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.648068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac119c-e5f5-4e7e-b8a1-e8395ecb5f6a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.684691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.685719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.686239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.686651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.687064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.687684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.687959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.688248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.688993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:09.689303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.691527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.698616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 191/375] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:09 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=2db6f108db484377bb8284827c2bc59c => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:09.699241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:09.762654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.831308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.842730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b8834-b2ea-4909-89eb-80887e168788 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.860620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.860620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85594-dbb3-4e0e-bc46-4df6ad0a5bac None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.896766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.898374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.898862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.899574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.900742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:09.901387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.903940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.912341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 192/376] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:09 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:10.001131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 185/377] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:10.007033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.165620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a721f-c14b-4a08-b7de-48c354b48536 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:10.213623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036f503-73b5-460c-b86c-6837c9c337e2 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.214079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036f503-73b5-460c-b86c-6837c9c337e2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.214482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036f503-73b5-460c-b86c-6837c9c337e2 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.216435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 186/378] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:10.219250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:10.220181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.220751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.221884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] PATH_INFO: `/v3/projects/c27876b25e104fc48bd2eb1b5131a55c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.223496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.223918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.224334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.225382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] RBAC: Authorizing `identity:get_project(project_id=c27876b25e104fc48bd2eb1b5131a55c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:10.227060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:10.229462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 193/379] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/projects/c27876b25e104fc48bd2eb1b5131a55c => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:10.238416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.250335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:10.251526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:10.273391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:10.354966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:10.399494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 187/380] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:10.410641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337830f-53d8-4173-b630-308c09c8ced7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:10.456791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:10.457486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.457768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.458040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] PATH_INFO: `/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.465063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] RBAC: Authorizing `identity:get_group(group_id=ead2f3cbb1ab4fb5929173b51af6c927)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:10.466549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88467e0c-635e-4130-918d-0565d1828023 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:10.468460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 194/381] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:10.475334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.514834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef334-6eb6-4fc2-b056-c78b9d76cc89 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.515164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef334-6eb6-4fc2-b056-c78b9d76cc89 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.515385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef334-6eb6-4fc2-b056-c78b9d76cc89 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.517064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 195/382] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:10.524221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.524519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.524777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.559925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:10.561192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:10.669191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ecb9e-8271-4e4f-9406-8533c6453473 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:10.733922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:10.734471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.734752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.735031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.735774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] RBAC: Adding query filter params (group.id=ead2f3cbb1ab4fb5929173b51af6c927, role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=c27876b25e104fc48bd2eb1b5131a55c) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:10.736089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:10.738626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:10.743746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 196/383] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 22:08:10.750564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 188/384] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/role_assignments?group.id=ead2f3cbb1ab4fb5929173b51af6c927&scope.project.id=c27876b25e104fc48bd2eb1b5131a55c&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:10.891967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.926357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.047624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480dfa6e-8476-466b-a771-ba18b2df33e2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.073892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.092424 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.093520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.094014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.094624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.109775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:11.115972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:11.116948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:11.117744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:11.120167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 197/385] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:11.126240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.151462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.226328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.256020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63218a-0862-41af-8c4b-cf99698c0403 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.256553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb302c1-fb4e-4fde-9908-b4d7d405dc21 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.301003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.301992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.302579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.303155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.304026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:11.304525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.310013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.310895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.311534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.311849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.312120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.321134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 198/386] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:11.328457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.335001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:11.344434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:11.345422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:11.346451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:11.349137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 189/387] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:11.351993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.504131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cf4ff-a17b-4538-b643-2a59f614d8d9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.548544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103909e0-70ff-44b9-8b84-4b85da3075c1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.573922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.574930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.575408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.575894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.577463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.579411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.579766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.582204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 199/388] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:11.590614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.611028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.620111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.620734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.621033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.621300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.621973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:11.622274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.623659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.641667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 190/389] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:11.644404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.806583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c445c3-2801-49a5-8000-504e2ee9a01a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.843757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b35b5-192e-4b91-836c-3565ee2241e6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.878597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.879241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.879517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.879784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.882142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.883612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.885519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 200/390] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:11.891487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.915270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.916445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.916954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.917446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.920430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.923103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.926631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 191/391] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:11.931772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.003545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.010696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.034003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc34a43-95cc-46e8-9f92-a268a802b18d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.082139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.082832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.083108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.083383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.088251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, group_id=348cbf60d8104a0398c2c1c4454ef06f, role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.089916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.120466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 201/392] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 23 22:08:11 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:12.132424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc886bb-b3b8-4cd7-8e3e-fed1316e48db None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.227376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.228488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.229037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.229521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.233657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.235432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c032-32fe-45ee-a16c-eadd7b0fb8bc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.238464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 192/393] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:12.245996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.424842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9b0a5-dbf5-4b81-9f3e-5e40009a044b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.462696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.463374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.463655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.463933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.468749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] RBAC: Authorizing `identity:create_grant(project_id=b85a8777ee454b11b412795d2ab8ec7b, group_id=348cbf60d8104a0398c2c1c4454ef06f, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.471046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced196c-a55a-4b3b-92e3-a744c85fda3a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.473502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.499024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 202/394] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 23 22:08:12 2022] PUT /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:12.546973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3e3b-bfa5-49d0-9f76-15764acc4736 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.547310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3e3b-bfa5-49d0-9f76-15764acc4736 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.547521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f3e3b-bfa5-49d0-9f76-15764acc4736 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.549334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 193/395] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:12.555532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.555908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.556107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.586060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:12.587297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:12.638276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199005-2841-43cb-b91d-2ab4bca95fe0 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.638630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199005-2841-43cb-b91d-2ab4bca95fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.638819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac199005-2841-43cb-b91d-2ab4bca95fe0 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.640424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 194/396] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:12.646750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.647027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.647298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.680795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 203/397] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:12.681984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:12.683219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:12.784681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 195/398] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:12.954213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.064961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.115929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee8b12-4e4f-4cfe-9d67-358259f71b87 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.140047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:13.162102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:13.201926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.203037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.203545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.204356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.225930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efe229-ac44-4257-8550-0f19c3dd9daa None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.239572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:13.258773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:13.260178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:13.261055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 204/399] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:13.268798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.324242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.325373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.325862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.326330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.349250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:13.354757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:13.355725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:13.356541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:13.365072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 196/400] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:13.366529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.419533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a2afb-a416-4101-86dc-e014db348a7a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.462267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.462796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.463076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.463350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.464044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:13.464353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:13.465837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100abdb-5acb-41c6-8574-87d414c81e5c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:13.476358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 205/401] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:13.477704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a118d1-34d9-4b90-8ec5-98c52de23762 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.477990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a118d1-34d9-4b90-8ec5-98c52de23762 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.478264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a118d1-34d9-4b90-8ec5-98c52de23762 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.479510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 206/402] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:13.483741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a118d1-34d9-4b90-8ec5-98c52de23762 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.528399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9a678-5b24-4fd5-b66a-d25b73178b54 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.530223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:13.566635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:13.583986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.584622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.584949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.585257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.585956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] RBAC: Adding query filter params (name=member) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:13.586300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:13.587899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ced5c2-8583-4f52-b8e3-2d542fed9067 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:13.603269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 197/403] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:13.605273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.605732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.606153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.630330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:13.631998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:13.659749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a118d1-34d9-4b90-8ec5-98c52de23762 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.702208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.703053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.703463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.703986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.705676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:13.707104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:13.712970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 207/404] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:13.712970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.732371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 198/405] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:13.734578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.861974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba975e-6c13-45f2-8ed4-4c883e20986f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.871686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:13.904720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:13.905568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:13.905956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:13.906320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:13.907606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:13.910763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:13.912672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 199/406] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:13.918387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:13.935068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e8c3e-ffe0-42fa-b940-4a1d754bd053 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:13.968425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.012290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.012985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.013265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.013538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.014736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.016224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.025676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 208/407] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:13 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:14.031005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.035377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553694f2-f046-4c76-abab-a29ac088997b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.075101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.076381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.076901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.077391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.080304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, group_id=348cbf60d8104a0398c2c1c4454ef06f, role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.082650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.108521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 200/408] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 23 22:08:13 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:08:14.114978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.187359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.228878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5fd19-dd2d-4840-a087-37ce283d5979 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.311006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.311770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.312016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.312201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.318959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.320506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.330120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 209/409] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:14.331996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.390086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9700d1-1ac5-4870-8f26-7bc95d07e1ab None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.458139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.479294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.479880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.480697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.481049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.535492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:14.550803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:14.552526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:14.553939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 201/410] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:14.562305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.668737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d3310-2bf6-4140-8573-e56287d4ce5c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.788900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.789779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.790067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.790347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.793970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] RBAC: Authorizing `identity:create_grant(project_id=aefaa1d5640d497f91a4c5d1d1980d20, group_id=348cbf60d8104a0398c2c1c4454ef06f, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.795472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f84dc9-115d-4417-bd1d-8f982a308009 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.807395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.825186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 210/411] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 23 22:08:14 2022] PUT /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20/groups/348cbf60d8104a0398c2c1c4454ef06f/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:14.826532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e46f-d948-465b-8dce-5250d991233a None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.826827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e46f-d948-465b-8dce-5250d991233a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.827096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e46f-d948-465b-8dce-5250d991233a None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.842105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 211/412] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:14.847967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c94-44ac-4a1f-b1c6-4361f1c0a797 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.848364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c94-44ac-4a1f-b1c6-4361f1c0a797 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.848518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2c94-44ac-4a1f-b1c6-4361f1c0a797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.866543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef6bab-e104-4c09-8cb3-baa369652f34 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.917624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e7ea2c94-44ac-4a1f-b1c6-4361f1c0a797 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:14.918879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e7ea2c94-44ac-4a1f-b1c6-4361f1c0a797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:14.975535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.976239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.976521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.976796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.983080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:14.983477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.984941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.003299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 202/413] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.009883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.045568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 212/414] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:15.183285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb27-841f-449d-8757-a3d2ba5a7279 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.183604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb27-841f-449d-8757-a3d2ba5a7279 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.183847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012fb27-841f-449d-8757-a3d2ba5a7279 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.185626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 213/415] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:15.188247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d2bcb-0175-4a13-8d14-b200903e1c42 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.191841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.192113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.192391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.230401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.231448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.231952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.232424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] PATH_INFO: `/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.234127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] RBAC: Authorizing `identity:get_group(group_id=ead2f3cbb1ab4fb5929173b51af6c927)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.235920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.238871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 203/416] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:15.245050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.245206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:15.246285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:15.277406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.320144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.392246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 214/417] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:15.398475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.467271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb64e68-7f0b-4874-9a9e-fe8977ae5f1f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.549697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.552877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.552877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.552877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] PATH_INFO: `/v3/projects/c27876b25e104fc48bd2eb1b5131a55c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.554368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] RBAC: Authorizing `identity:get_project(project_id=c27876b25e104fc48bd2eb1b5131a55c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.557948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.562153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 204/418] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/projects/c27876b25e104fc48bd2eb1b5131a55c => generated 344 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.572384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.612753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2ee5-abf6-4316-b098-55375c81c78f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.708329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.709450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.710141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.710621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.731480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:15.742976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:15.743920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:15.744703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:15.746171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 215/419] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:15.750583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.770554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.797211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff718595-463a-4324-9aeb-facaf643ad1c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.812357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.858194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.859233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.859823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.860429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] PATH_INFO: `/v3/projects/c27876b25e104fc48bd2eb1b5131a55c/groups/ead2f3cbb1ab4fb5929173b51af6c927/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.864594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] RBAC: Authorizing `identity:create_grant(project_id=c27876b25e104fc48bd2eb1b5131a55c, group_id=ead2f3cbb1ab4fb5929173b51af6c927, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.869365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.901003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 205/420] 10.222.0.69 () {58 vars in 1442 bytes} [Tue Aug 23 22:08:15 2022] PUT /identity/v3/projects/c27876b25e104fc48bd2eb1b5131a55c/groups/ead2f3cbb1ab4fb5929173b51af6c927/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:08:15.902981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.919273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eba484-600d-4aec-96cb-b5ab44c672b8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.994579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.995703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.000508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.000508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.054334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:16.069179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:16.070228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:16.071039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:16.072525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 216/421] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:16.082635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.115754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91289f56-b652-4f16-ac8d-0444b1b9db64 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.180830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.181830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.182272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.182701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.183818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:16.184314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.187012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.202893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 206/422] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:16.213033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.217647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.268055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.281754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff6fc2-29f4-439f-8739-cbfeabccb8d6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.319944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.320564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.321439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.321439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.321797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:16.322192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.323478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.333334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 217/423] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:16.341850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.451185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf4119-10e3-4697-99e1-92ec5f096235 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.561806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.563255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.563986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.564733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.616626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9449f7-2fce-4ec2-884b-62a82c095bb2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.716645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.718124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.718847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.719579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.748321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.751514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.768877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.790222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.889344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.889344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.111115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 207/424] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 899 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:08:17.118134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 218/425] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:17.121131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.126675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.231943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.288025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ece43-34bb-4b83-beb0-81e0877c4fa2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.316488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bc840-3b9d-4db6-a837-00364bf7181e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.319211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.327815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.329018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.329018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.329388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.331113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.333223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ade45-afb2-4b42-b587-138023cec585 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.335891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 219/426] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:17.337391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c550b-22e4-44f3-9b87-2124ec4f1b39 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.337679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c550b-22e4-44f3-9b87-2124ec4f1b39 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.337953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c550b-22e4-44f3-9b87-2124ec4f1b39 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.344251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 220/427] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:17.345288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c550b-22e4-44f3-9b87-2124ec4f1b39 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.386898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.387920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.388470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.389058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] PATH_INFO: `/v3/projects/b85a8777ee454b11b412795d2ab8ec7b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.391134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=b85a8777ee454b11b412795d2ab8ec7b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.394139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b98245-e8d4-4533-986e-de4640c79fe9 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.402293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 208/428] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/projects/b85a8777ee454b11b412795d2ab8ec7b => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:17.404767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.407817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.409015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.439813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:17.442119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:17.475654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c550b-22e4-44f3-9b87-2124ec4f1b39 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.499646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.518088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.519190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.519465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.519743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.521008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.522600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.524245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 221/429] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:17.525156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.569907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 209/430] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:17.571423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.655930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862235-541a-4d8a-abd3-5fcad11072ac None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.698161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.698856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.699132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.699407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.700621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.702764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.705731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 222/431] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:17.720591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.791581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.844276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65ba83-665a-48bc-96a6-6ecd0735fa1c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.884785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.885441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.885865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.886265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.887210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:17.887819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.888531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.890134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac7926-275b-467b-82e9-710d727dca02 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.893456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84c9e-e770-4869-bde4-f6fb1d140684 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.899005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 223/432] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:17.900385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c7d8-2b97-4f8d-a7b2-2b00b2f9f152 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.900669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c7d8-2b97-4f8d-a7b2-2b00b2f9f152 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.901070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6c7d8-2b97-4f8d-a7b2-2b00b2f9f152 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.902807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 224/433] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:17.914768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.915138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.915343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.960962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:17.963079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:18.022395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.023595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.024099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.024673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.026235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=b85a8777ee454b11b412795d2ab8ec7b) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.026786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.035573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.065823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 210/434] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=b85a8777ee454b11b412795d2ab8ec7b&role.id=2db6f108db484377bb8284827c2bc59c => generated 611 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.075441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.159734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 225/435] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:18.326803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8c44c-fd7b-4cfe-a4ef-94c86842ac22 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.392287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.395820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.395820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.395820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.415357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:18.425665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:18.426606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:18.427407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:18.429462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 211/436] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:18.436538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.524586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.600260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f310a-066b-4442-9788-b4a862beb301 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.644144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.645176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.645636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.646084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.646977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.647459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.649063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.664103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 226/437] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.665909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.699625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.705511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.851912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5511f7-f05b-4d2b-8507-fdd9ee0488ae None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.889718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a29ba1-bf8a-4451-bbe3-73f5346d0f99 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.897976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.899004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.899484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.899956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.922512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.955548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.956619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.957220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.957707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.978682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:18.990996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:18.992019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:18.992862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 227/438] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:19.000162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.001701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.005112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.033645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.159128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 212/439] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:19.165664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.180023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78cff-508c-4a7b-b7a0-1b723c28dfd0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.222591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.223219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.223501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.223764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.224443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.224746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.226222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.242349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 228/440] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:19.249062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.308644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.346336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d087246-0d08-483e-a448-a832e60fd24f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.389356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.403963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.404652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.404961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.405235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.406441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.407894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988dbf5-770b-4ec9-b5d8-a2b34653ec52 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.410243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 213/441] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:19.411531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3471-926b-4567-9131-4c86a92fecbb None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.411739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3471-926b-4567-9131-4c86a92fecbb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.411981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a3471-926b-4567-9131-4c86a92fecbb None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.413304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 214/442] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:19.419183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.419463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.419768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.430159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603e747-c675-49ef-ad7a-4c278ccb32f8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.439281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:19.441458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:19.485257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.485880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.486146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.487287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.536973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 215/443] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:19.537844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.603279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.604752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.650228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.675595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fdeab-c476-4f09-8842-5637df381199 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.707454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.724735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.725552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.726021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.726470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.727928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.729789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.732296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 216/444] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:19.738692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.774050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 229/445] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:19.774939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.860647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c991c9-c0e8-4ab9-9e04-4fd9d48f179b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.900942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab7b9-0a6d-4277-a1fb-ff16b5edb409 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.903261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.903883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.904163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.904439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.905217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.905529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.906986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.915026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 217/446] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:19.915870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.947792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.948418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.948726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.949072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] PATH_INFO: `/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.950727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=aefaa1d5640d497f91a4c5d1d1980d20)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.953904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.965657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 230/447] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/projects/aefaa1d5640d497f91a4c5d1d1980d20 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:19.970254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.977310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:20.005424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:20.070412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83372-340e-4f79-a9c4-0e76a68a3002 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:20.124721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:20.125440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.125715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.125998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.147668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:20.154430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735b6e5-6ad8-4858-b426-ee6fde401ba0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:20.157055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:20.158308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:20.159388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 218/448] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:20.166344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:20.206326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:20.206889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.207175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.207460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] PATH_INFO: `/v3/groups/348cbf60d8104a0398c2c1c4454ef06f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.208639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] RBAC: Authorizing `identity:get_group(group_id=348cbf60d8104a0398c2c1c4454ef06f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:20.210150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:20.211768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 231/449] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/groups/348cbf60d8104a0398c2c1c4454ef06f => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:20.222469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:20.305026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:20.311280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795e0f1-1822-443c-a0ca-328ac063977a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:20.329645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:20.352981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:20.353694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.353868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.354138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.354239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b5b78-1775-4d48-b5bd-26924b45a4d5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:20.354807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:20.355110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:20.356513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:20.366138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 219/450] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:20.374892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:20.397579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:20.398309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.398608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.398952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.399707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] RBAC: Adding query filter params (group.id=348cbf60d8104a0398c2c1c4454ef06f, role.id=2db6f108db484377bb8284827c2bc59c, scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:20.400016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:20.401840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:20.410707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 232/451] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:20 2022] GET /identity/v3/role_assignments?group.id=348cbf60d8104a0398c2c1c4454ef06f&scope.project.id=aefaa1d5640d497f91a4c5d1d1980d20&role.id=2db6f108db484377bb8284827c2bc59c => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:20.520722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398e6dc-b3d3-4571-a1de-6e2c9e10f08e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:20.587882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:20.588976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.589486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.589987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.665626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:20.697781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:20.699569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:20.862707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 220/452] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:20.869220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.038856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef7cc4-159c-4623-bbf9-216b3562b9fc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.101734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.102436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.102856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.103182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] PATH_INFO: `/v3/projects/c27876b25e104fc48bd2eb1b5131a55c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.104630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] RBAC: Authorizing `identity:get_project(project_id=c27876b25e104fc48bd2eb1b5131a55c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.106204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.107967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 233/453] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:08:20 2022] GET /identity/v3/projects/c27876b25e104fc48bd2eb1b5131a55c => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:21.114889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.207008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:21.234059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e333-1d55-47ab-8a80-32a3fb4e89c5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.272834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.273575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.273894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.274210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] PATH_INFO: `/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.275453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] RBAC: Authorizing `identity:get_group(group_id=ead2f3cbb1ab4fb5929173b51af6c927)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.277022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4ca65-c4da-4a81-aa76-378a722062d6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.278714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 221/454] 10.222.0.69 () {56 vars in 1180 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/groups/ead2f3cbb1ab4fb5929173b51af6c927 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:21.285695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.289936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:21.460783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f3e1f-8d77-4f2f-971d-59d9c6de6e26 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.504229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.504999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.505391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.505639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.506470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] RBAC: Adding query filter params (group.id=ead2f3cbb1ab4fb5929173b51af6c927, role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=c27876b25e104fc48bd2eb1b5131a55c) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:21.506831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.508445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ea81f-ad74-4670-aa26-3b170f4d0ab4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.515255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 234/455] 10.222.0.69 () {56 vars in 1376 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/role_assignments?group.id=ead2f3cbb1ab4fb5929173b51af6c927&scope.project.id=c27876b25e104fc48bd2eb1b5131a55c&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:24.501801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a057e8-cb54-4865-a970-27c7d99b61d7 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.503388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a057e8-cb54-4865-a970-27c7d99b61d7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.503388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a057e8-cb54-4865-a970-27c7d99b61d7 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.505333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 222/456] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:24.516551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7087bb-73af-4da9-a717-9261647cf19a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.518064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7087bb-73af-4da9-a717-9261647cf19a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.518064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7087bb-73af-4da9-a717-9261647cf19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.557928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3a7087bb-73af-4da9-a717-9261647cf19a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:24.560015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3a7087bb-73af-4da9-a717-9261647cf19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:24.703342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:24.719492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 235/457] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:24.919581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2bed9-e21d-4a3d-a67f-885c0a070ddd None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.920115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2bed9-e21d-4a3d-a67f-885c0a070ddd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.920572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2bed9-e21d-4a3d-a67f-885c0a070ddd None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.923610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 223/458] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:24.928936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.929310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.929561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.956034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:24.957438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:25.116485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 236/459] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:25.143005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2bed9-e21d-4a3d-a67f-885c0a070ddd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:25.421330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2bed9-e21d-4a3d-a67f-885c0a070ddd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:25.518314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:25.519586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.519816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.520237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.543914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:25.546686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:25.557602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:25.586449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:25.588203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:25.591488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:25.591488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:25.591488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:25.596851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 224/460] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:25.597882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:25.620101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:25.777250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770a39f-ef4a-44e3-aefb-fb10bbed1e75 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:25.824013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:25.824998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.825479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.825915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.841184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:25.843986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:25.859562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b940f7-2558-438f-86eb-d983bac41960 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-6c0fb59a-a5bd-4d9f-b79e-201a197e0408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:25.863339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:25.864492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:25.865503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:25.865503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:25.865503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:25.867462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 225/461] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:25.869198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3b23-aed0-479b-97d6-dddca30ae754 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.869669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3b23-aed0-479b-97d6-dddca30ae754 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.870089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c3b23-aed0-479b-97d6-dddca30ae754 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.871628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 226/462] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:25.873124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3b23-aed0-479b-97d6-dddca30ae754 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:25.910006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:25.922869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:25.924522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.925315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.925939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.926894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:25.927413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:25.929243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e3c84-e365-421f-af01-e84e8aa4736e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:25.959057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 237/463] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:25.960433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665da3-e9db-4810-89b8-369fc8be4655 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.960699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665da3-e9db-4810-89b8-369fc8be4655 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.961015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665da3-e9db-4810-89b8-369fc8be4655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.975598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:25.983317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-db665da3-e9db-4810-89b8-369fc8be4655 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:25.984545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-db665da3-e9db-4810-89b8-369fc8be4655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:26.042322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c3b23-aed0-479b-97d6-dddca30ae754 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:26.074192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 238/464] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:26.077085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9d54-4cd1-4cf3-b298-affd54d01043 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.077950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9d54-4cd1-4cf3-b298-affd54d01043 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.079068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e9d54-4cd1-4cf3-b298-affd54d01043 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.083049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 239/465] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:26.084978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9d54-4cd1-4cf3-b298-affd54d01043 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:26.096972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:26.097819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.098131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.098407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.099082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:26.099440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:26.101052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfd3e8-d822-4594-9371-0c285303b702 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:26.116329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 227/466] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:26.117698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.117988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.118262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.138975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:26.140312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:26.238643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 228/467] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:26.246159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:26.327897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e9d54-4cd1-4cf3-b298-affd54d01043 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:26.337825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:26.397383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:26.409994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:26.411890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.412628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.413419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.415157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:26.418881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:26.470149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 240/468] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:08:26 2022] POST /identity/v3/users => generated 246 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:26.542540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dda87b-30aa-4337-8ffe-dc707f8f7aeb None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:26.564761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:26.605126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:26.606062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.606538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.607012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.608230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:26.611138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:26.656985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 229/469] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:08:26 2022] POST /identity/v3/users => generated 249 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:26.804238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:26.816416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4e22b-e0c6-493b-b1a8-394fde8d046b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:26.886844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:26.887846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.888328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.888850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.912561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:26.915366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:26.962232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:26.964186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:26.966940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:26.966940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:26.966940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:26.969663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 241/470] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:26.982163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.001695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.017218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc5e9-f927-4e33-a11d-189d62481f2d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.035395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.085717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.088001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.088001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.088001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.115968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.122197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-95e5df30-52ee-45d5-bd6a-8dc4e4fc8e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:27.160241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:27.161975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:27.164402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:27.164402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:27.164402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:27.164402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 230/471] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:27.166816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfca13-b062-4beb-a80d-4adf8409a861 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.167308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfca13-b062-4beb-a80d-4adf8409a861 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.167782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfca13-b062-4beb-a80d-4adf8409a861 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.172530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 231/472] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:27.175091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfca13-b062-4beb-a80d-4adf8409a861 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.190827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e01530-8b0c-4e66-bf92-888aea1a0b3a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.264718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.265795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.266267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.266716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.268945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:27.269282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.271526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5744412-061e-459d-874b-61e3f127d8c1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.295320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 242/473] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:27.296855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.297169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.297524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.347827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:27.352129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:27.415392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfca13-b062-4beb-a80d-4adf8409a861 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.485342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.487225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.487923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.488608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.490210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:27.491114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.494027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.510635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 243/474] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:27.512484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.541957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 232/475] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:27.549545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.554313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.588734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.819784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d778efc-e847-4505-a58b-e8ec52cc4d6b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.869571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2abf-02bf-4775-a5e2-bd3b60a63567 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.889827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.890905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.891396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.891877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.893871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.896538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.957536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 244/476] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:08:27 2022] POST /identity/v3/users => generated 248 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:27.974947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.975566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.975847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.976121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.976781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.978283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.013852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 233/477] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:08:27 2022] POST /identity/v3/users => generated 248 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:28.083169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.199746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:28.251981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d0718-34be-420d-b5ec-600238b98697 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:28.330344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:28.331140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.331632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.332126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.333512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:28.336139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.350695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.sql.core [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:08:28.350695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 22:08:28.350695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [parameters: {'id': '09ab24dfd7674d9f8f021654c3e14877', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 22:08:28.350695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81715) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:28.382757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:28.384412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application yield resource Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise self.value Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application session.commit() Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:08:28.387405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:08:28.389686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:28.392596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:28.400903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [parameters: {'id': '09ab24dfd7674d9f8f021654c3e14877', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:28.403991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 22:08:28.407107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:28.410281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 245/478] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 23 22:08:28 2022] POST /identity/v3/roles => generated 144 bytes in 304 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:28.410445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.543468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:28.625992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11420b-1cf7-4804-b153-89cf28f356ae None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:28.708483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:28.709190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.709477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.709749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.723577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f4e1e4ac-a06f-457a-a83f-1c7516a0b1c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:28.729142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:28.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:28.733631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 234/479] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:28.739325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.932366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f0123-633e-45da-8559-3d3b003bead9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:29.000249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:29.000904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:29.001209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:29.001465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:29.002718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:29.003252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:29.004893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680806a-a6f3-4594-92f2-171b6439cc54 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:29.006744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:29.023476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 246/480] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:29.778066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3dfd-2aaf-4b44-81f3-82e3455c9a84 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:29.778989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3dfd-2aaf-4b44-81f3-82e3455c9a84 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:29.779410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b3dfd-2aaf-4b44-81f3-82e3455c9a84 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:29.781025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 235/481] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:29.788004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5319-c88e-4b74-b2c5-36f488cfdddb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:29.788451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5319-c88e-4b74-b2c5-36f488cfdddb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:29.788850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d5319-c88e-4b74-b2c5-36f488cfdddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:29.810653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1f2d5319-c88e-4b74-b2c5-36f488cfdddb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:29.811877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1f2d5319-c88e-4b74-b2c5-36f488cfdddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:29.910694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 247/482] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:30.356209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2a80-883c-4fbb-83c0-cce48541ce89 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.356548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2a80-883c-4fbb-83c0-cce48541ce89 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.356763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2a80-883c-4fbb-83c0-cce48541ce89 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.358469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 236/483] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:30.365184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.365698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.365800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.391084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:30.392308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:30.445243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2a80-883c-4fbb-83c0-cce48541ce89 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:30.540548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 248/484] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:30.644080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2a80-883c-4fbb-83c0-cce48541ce89 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:30.682272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:30.702139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:30.703104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.703781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.704215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.723455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:30.729347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:30.730523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:30.731532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:30.734097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 237/485] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:30.743490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:30.855790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:30.920733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4db6d-0f20-4b33-a6ba-0d4c8f867545 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:30.943192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:30.983366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:30.984044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.984325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.984595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.985311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:30.985614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:30.987651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.004892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 249/486] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:31.014128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.198493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0809065-9375-41ff-8fcb-75fc8eec8b16 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.259361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bb390-28a9-4f48-96d4-a1365935d2c5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.283723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:31.285747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.289237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.290646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.291399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.313798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:31.319295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-76c62aad-0f62-4e83-af50-1539d29f1526 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:31.320422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:31.322508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 238/487] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:31.324233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009901a8-7b79-47bd-89da-ff5eb6ab153a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.325672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009901a8-7b79-47bd-89da-ff5eb6ab153a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.325672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009901a8-7b79-47bd-89da-ff5eb6ab153a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.326950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.327737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.328445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.331203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 239/488] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:31.332251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009901a8-7b79-47bd-89da-ff5eb6ab153a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.358676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:31.362806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b43aa51a-040d-4921-9379-3bc999b882e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:31.397764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:31.400214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:31.401884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:31.401884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:31.401884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:31.407317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 250/489] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:31.409987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.410473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.411079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.443676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:31.453398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:31.455687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:31.596506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009901a8-7b79-47bd-89da-ff5eb6ab153a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.619917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 251/490] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:31.621667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.688534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.690389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.691287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.693307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.696677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:31.697567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:31.700680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.719844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 240/491] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:31.730801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.876427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:31.880659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e464721-2435-4bc6-ba4f-50989874ca65 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.951664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.952297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.952580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.952879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.953791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:31.954104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:31.960056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.977884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 252/492] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:31.978664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.009536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30cd2-6aac-459f-afea-640d3ebcdfbb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.012306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.059556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.060640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.061161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.061645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.083851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.086859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:32.119048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:32.120078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:32.121260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:32.121260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:32.121260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:32.121436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 241/493] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:32.122909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.126538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845e51-0879-4f92-ac6f-12844f2d160b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.183633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.184631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.185131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.185603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.205526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-8b68bd08-aca0-4233-8d02-be9418a185a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:32.216497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:32.218018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:32.218936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 253/494] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:32.221855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-f9f6-4b6d-b18f-1523c31f0af2 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.222336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-f9f6-4b6d-b18f-1523c31f0af2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.222905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-f9f6-4b6d-b18f-1523c31f0af2 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.228964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 254/495] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:32.228964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3efd2-f9f6-4b6d-b18f-1523c31f0af2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.264409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.291514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ae27a-64e4-4c5e-a50a-b52f4d242bd1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.336198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.337036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.337393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.337758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.348757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.350352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:32.365849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:32.366969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:32.368160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:32.371955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 242/496] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:32.372949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.393594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3efd2-f9f6-4b6d-b18f-1523c31f0af2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.399993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.448468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.449660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.450081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.450575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.451760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:32.452324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.455859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1c35e-57ba-45ab-abbc-001af1671ca9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.480939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 255/497] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:32.480939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.481174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.481675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.515590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:32.516465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403e19c-67d6-4fbe-b6a3-d145b8a2642c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.518419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:32.559576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.560241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.560522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.560794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.561510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:32.561816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.563274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.578399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 243/498] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:32.578399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.657342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 256/499] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:32.659274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.688908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.735937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.781396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abd241-61ef-45b3-ab35-f7ee58715182 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.848464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.849556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.850018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.850495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.851835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:32.852368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.855230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.889419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057563a-0793-4876-9df2-9d8997e98d7f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.927073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 244/500] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:32.928940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.963156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.964296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.964759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.965260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.980121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.983126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-81c8f916-ad24-4b87-bf54-aaec42622586 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:33.007882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:33.009710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:33.011460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 257/501] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:33.012565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5676-749b-421b-a27d-34c686612afe None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.012565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5676-749b-421b-a27d-34c686612afe None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.012565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5676-749b-421b-a27d-34c686612afe None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.021068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 258/502] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:33.021068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5676-749b-421b-a27d-34c686612afe None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:33.112878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4f3f0-051f-45d2-9cc4-1ee52b81d76e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:33.148901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:33.178607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:33.179714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.180229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.180700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.185964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:33.203139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:33.206237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:33.207515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5676-749b-421b-a27d-34c686612afe None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-df69cc06-4755-4f16-889f-b1ae50f54655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:33.233726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:33.234761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:33.235664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:33.235664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:33.235664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:33.235664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 245/503] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:33.242025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.242025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.242025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.266990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:33.268996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.269166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.269490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.270792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:33.272709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:33.356007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:33.357705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:33.399698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 246/504] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:33.401530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:33.477995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:33.540620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 259/505] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:33.542090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:33.629057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e896f-ae24-4f91-857b-22834ab404c1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:33.663920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:33.692284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:33.694076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.694571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.695079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.696466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:33.697055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:33.699834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:33.737674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 247/506] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:33.739139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:33.743893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab2382-ad7b-4537-9ce6-02202a8bf69a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:33.807067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:33.808034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.808532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.809054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.829004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:33.839077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:33.840874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:33.842420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 260/507] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:33.845209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:33.883218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:33.930276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129849cf-e8f3-46cf-90c4-8e8c8b94e996 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:33.994664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:33.995707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.996181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.996743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.997896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:33.998436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.000891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.009367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd406-c0fd-4180-a285-0a1052e2db6b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.027365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 248/508] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.027365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.075723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.076269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.076547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.076859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.087830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.095749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.098855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:34.126440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:34.128881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:34.131469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:34.131469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:34.131469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:34.131469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 261/509] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:34.131469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.179516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446278b9-1727-4878-8b9a-224091a2f7c5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.243134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.244171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.244593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.245085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.263589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.297791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88edd0-1abe-4903-8f04-2c67c41c93f1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.360020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.361677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.361887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.362715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.363189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.363648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.384036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.386877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.404244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:34.415275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:34.416722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:34.419383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:34.419383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:34.419383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:34.419383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 262/510] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:34.419788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.514371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 249/511] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:34.515469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.593596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ecb5-9cf6-4dd9-91c0-2c4ec643853a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.640234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.640985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.641447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.641907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.643796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:34.644328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.646849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.649441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.661605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 263/512] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.662615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.672857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7394c-1849-4d78-9190-43a4af81fa06 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.719520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.720262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.721371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.722196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.725763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.732796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.734665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:34.750358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:34.752946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:34.754131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 250/513] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:34.754705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.805529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73eef6-2f9f-43bf-b6f6-0b1b29a90613 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.848954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.849582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.849863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.850137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.850788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:34.851095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.852496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.871422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 264/514] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.871422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.895496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc9a72-a911-49c5-9a2d-12692651b111 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.937061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.940321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.941828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.942286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.942729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.943600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:34.944049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.945685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.964307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 251/515] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.965756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.001292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da4d35-6579-4bb2-8d0f-9ded72f96b09 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.044032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.044256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.045049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.045429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.045862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.060002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.061932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:35.082017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:35.084128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:35.086268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:35.086268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:35.086268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:35.086268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 265/516] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:35.086268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.104866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3f16-294b-43ca-a6e4-cf113b3f514f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.159441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.160493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.161046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.161537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.181867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.184711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:35.214168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:35.215353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:35.216252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:35.216252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:35.216252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:35.216252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 252/517] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:35.217427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c89788-6bf5-4b8f-9050-77f4ccc7a268 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.217654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.231504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.267261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.269665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.270222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.270594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.273313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:35.273313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.274236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.327274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 266/518] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:35.328836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.381921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b63a9-d4bb-49e2-b0ae-0af06b2521dc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.392350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.431265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.431924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.432202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.432479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.440606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.442170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:35.457429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:35.458987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:35.460250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 253/519] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:35.461196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.505841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99465583-e4fd-46d0-97e0-8b7b83d22235 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.565951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.566842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.567242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.567635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.568778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.571542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.580861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610a09e-015f-423d-8552-ab401c9babc6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.616566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 267/520] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:08:35 2022] POST /identity/v3/users => generated 247 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:35.616566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.640354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.641227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.641897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.642993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.645076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:35.645559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.647243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.655203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.669709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 254/521] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:35.671997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.731192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.803687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d2401-c0d4-4075-a469-32c0b58fc9e1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.844990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.846150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.846600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.847091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.847816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:35.848269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.850064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.854378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8f494-7a87-4bff-9d5a-5f066bec42cc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.865380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 268/522] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:35.866260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.914057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.915093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.915554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.916009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.007523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.009450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.019452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.047320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.059178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcd7ce-dd6c-45a2-9961-1ce5cd5173ae None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.115917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:36.117131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.117638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.118114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.119464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:36.120027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.122830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.160544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 269/523] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:36.162063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.190676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 255/524] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:36.190676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.355676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428bb3f-0c0e-42a5-b26e-c693ae9836f2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.366843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e86fd-656f-4a21-91b5-1b86760338a8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.412623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:36.413699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.413979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.414256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.424992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.428209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.430039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.442203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:36.442791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.443079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.443352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.452231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:36.453840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:36.456166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:36.459938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:36.461847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.462098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 270/525] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:36.462098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.464425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:36.487227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:36.489095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:36.490817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:36.493283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 256/526] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:36.495208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.655574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9c29-9d22-4a60-acba-2740aab8a51e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.679434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ecd1-bcc7-40c9-b5e9-653a804ce73e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.708404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:36.709433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.709930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.710393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.731423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.733983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:36.758070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:36.761089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:36.762953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:36.762953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:36.762953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:36.763288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:36.763288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.763288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.763288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.763783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=ee0b9bc7e5fa4b0d9f67ea235dae32a6) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:36.763783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:36.765471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 257/527] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:36.765663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:36.768688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.792402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 271/528] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/role_assignments?user.id=ee0b9bc7e5fa4b0d9f67ea235dae32a6&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:36.794357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:36.856919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.959670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5306f-3dfe-430f-bb7b-79acbbc2378b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:36.989093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:37.024405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.025417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.025843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.026234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.027079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:37.027501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:37.030054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:37.063888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 258/529] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:37.065393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:37.085190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f861f1-cd6d-473a-a28b-aae1ca6fd252 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:37.168749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.169534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.169863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.170239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.172056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:37.172463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:37.176435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:37.228265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 272/530] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:37.228265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:37.309044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:37.315107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4982-ab83-457a-bd57-c7ce655229d3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:37.381158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.381158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.381158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.381692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.382906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:37.385131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:37.388350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:37.416676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 259/531] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:37.416676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:37.506822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b5fdd-6560-4635-b42a-ed28a17e2ec2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:37.582968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:37.619274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.620887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.621710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.622568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.625029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:37.626163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:37.629972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:37.639974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5b99f-492f-46cb-a80b-3f79547cf444 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:37.642728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 273/532] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:37 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:37.644789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:37.815996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.820619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.821602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.822875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.935066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.030095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.034924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.037176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3a35-b95b-4fd7-a3f7-816c834ec450 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.170976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.172517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.173299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.174094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.191573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.195050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:38.222091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:38.223745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:38.225510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:38.231061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 274/533] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 587 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:38.248353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.322885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 260/534] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 911 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:38.330322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.398718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.453176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66319cf-f280-4993-a05c-ff769abbb773 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.502708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.503410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.503693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.503968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.510038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:38.510425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.511984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.535915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.547119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 275/535] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:38.551306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.637804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80484f-74bd-4603-a06d-4c3e8d02ce5f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.708274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.708850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.709142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.709418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.741274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.745179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:38.770113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:38.772294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:38.774004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:38.774004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:38.774004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:38.774004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 261/536] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 444 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:38.784357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.836665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d38fef-aa32-41f6-b2de-ebe0985d46d5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.893417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.936937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.937836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.938120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.938397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.939837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=76d8c7621f2a472ca879b60d7340edc8) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:38.941052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.942632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad27cc6-468c-414f-b8fe-c7b5ce8a8279 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.951946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 276/537] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/role_assignments?user.id=76d8c7621f2a472ca879b60d7340edc8&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:38.953405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080486bc-bf03-4159-bcd7-1dff5285216b None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.953942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080486bc-bf03-4159-bcd7-1dff5285216b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.954284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080486bc-bf03-4159-bcd7-1dff5285216b None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.956192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 277/538] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:38.978608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806203f-4774-45e5-accc-58abca331224 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.978871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806203f-4774-45e5-accc-58abca331224 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.979178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806203f-4774-45e5-accc-58abca331224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.023554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b70ec-2744-4d3d-bd02-27c92c1045b6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.025363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0806203f-4774-45e5-accc-58abca331224 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:39.026761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0806203f-4774-45e5-accc-58abca331224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:39.057303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:39.105986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.107102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.107620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.108293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.109749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:39.110319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:39.113770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:39.155233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 262/539] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:39.165500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.167595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 278/540] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:39.369707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4af1ac-614c-4fef-81d6-62c38c2e9250 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.425516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.425516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.425516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.425516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.442199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:39.443711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:39.466900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:39.470225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:39.473548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 263/541] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:39.484145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806203f-4774-45e5-accc-58abca331224 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.633942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806203f-4774-45e5-accc-58abca331224 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.637219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:39.689468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.690165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.690442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.690711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.691431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:39.691733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:39.693241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:39.711737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 279/542] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:39.717929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.725025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.795917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:39.868605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a9d1c-9468-4175-bd20-f33ce12b5a54 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.918242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.918817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.919096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.919373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.941667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:39.944886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a2d85-0208-40a1-8c3e-c9b6c264da46 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:39.947179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:39.948320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:39.949684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 280/543] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:39.957033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.985658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.987171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.987451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.987752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.988510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=3675dd6a15f146f69ce8ffd72fff2999) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:39.988912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:39.990403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213deef5-43c2-496e-8537-03bcbd5a21c7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:39.997379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 264/544] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/role_assignments?user.id=3675dd6a15f146f69ce8ffd72fff2999&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.016517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f36f08-c63a-4a32-9b21-11f25cde4633 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.016798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f36f08-c63a-4a32-9b21-11f25cde4633 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.017221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f36f08-c63a-4a32-9b21-11f25cde4633 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.019236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 265/545] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:40.019885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.027681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.028244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.028658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.050757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:40.052257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:40.140841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09348106-e876-41d3-8765-b1e3f7a98279 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.146245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 266/546] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:40.176420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.177001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.177264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.177538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.178233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:40.178539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.179954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.190276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 281/547] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.195790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.245487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.335954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9806-04c1-4fda-9558-398bee9cc7d6 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.374930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.376386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.377206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.377697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.389697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.391537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:40.425015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:40.426702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:40.428496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:40.428496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:40.428496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:40.428496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 267/548] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:40.433381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.574873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.605206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da028-6de7-479c-ab64-eb8a4af1a274 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.657311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.658472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.658743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.659016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.659687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:40.659988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.661475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454717-7405-4fbb-bede-a15bfe4254e7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.677042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 282/549] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.684792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.740648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04aded-b88b-4b9a-a9f0-b817a775fbe9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.740987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04aded-b88b-4b9a-a9f0-b817a775fbe9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.741222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04aded-b88b-4b9a-a9f0-b817a775fbe9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.742861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 283/550] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:40.749064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04aded-b88b-4b9a-a9f0-b817a775fbe9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.834547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.870887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48701ec-1f56-4ad2-873f-08517f9c4f30 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.908707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04aded-b88b-4b9a-a9f0-b817a775fbe9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.919241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.920325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.921229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.921788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.934050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.936243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.951420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.952077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.952361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.952613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-901ee4c7-9c01-4eed-9613-46e5af5faa44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:40.955229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:40.957048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:40.958586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:40.968848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:40.969464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 268/551] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:40.972225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:40.975320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:40.976788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 284/552] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:40.981132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.981132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.981132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.981806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.989771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:41.010286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:41.012145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:41.116109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d36a2-2513-4e4f-b6d8-83d4bb5fd4a6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:41.132849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 269/553] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:41.132849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:41.231326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:41.234016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:41.235044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:41.235516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:41.236528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:41.237536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:41.237898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:41.240105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:41.269554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 285/554] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:41.275804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:41.283227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789eac1-25eb-4b40-b143-d05edc5cbfe3 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:41.338652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480ee-1421-4f19-9029-df471e454251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:41.340101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480ee-1421-4f19-9029-df471e454251 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:41.341011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480ee-1421-4f19-9029-df471e454251 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:41.342155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677480ee-1421-4f19-9029-df471e454251 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:41.344467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677480ee-1421-4f19-9029-df471e454251 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:41.345862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677480ee-1421-4f19-9029-df471e454251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:41.349213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677480ee-1421-4f19-9029-df471e454251 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:41.379811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 270/555] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:08:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:41.390633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480ee-1421-4f19-9029-df471e454251 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:41.484379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:41.548219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677480ee-1421-4f19-9029-df471e454251 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:41.561591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4abc-9bb2-474c-a1f4-3f2993b2ce3e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:41.581527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:41.592016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:41.593014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:41.593380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:41.593754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:41.638740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:41.640368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:41.641160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:41.642663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:41.669014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:41.672209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:41.711396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:41.713293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:41.715048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:41.715048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:41.715048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:41.715048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 286/556] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:41.716467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:41.740721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:41.743870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:41.913716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c26c4-ee1b-450d-a664-147d54b87899 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:41.928371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 271/557] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:41.929862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:41.950576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:41.981996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:41.982994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:41.983389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:41.983847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:41.987488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.004601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-8b33f717-9ff0-4ed9-9960-fb5688a4a487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:42.013740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:42.016313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 287/558] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:42.019418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86691b-f5cf-4fce-aeca-33d48238d9c5 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.020997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86691b-f5cf-4fce-aeca-33d48238d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.020997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86691b-f5cf-4fce-aeca-33d48238d9c5 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.021833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 288/559] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:42.024395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86691b-f5cf-4fce-aeca-33d48238d9c5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.105882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd1e870-15a6-4a18-8b0f-e1810fbb69b1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.152843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.153650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.154054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.154472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.155309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:42.155745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.157522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:42.179550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 272/560] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:42.181145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.217118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86691b-f5cf-4fce-aeca-33d48238d9c5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.275262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.276318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.276821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.277319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.295164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.297575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:42.324117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6a0a779b-1a4c-45e9-88a0-811bf7b96aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:42.328272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:42.330946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 289/561] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.335107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.352195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b914b8-55c2-408d-adc3-1f2d3aa08cf7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.367295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:42.369888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:42.421936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.422174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.424289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.424934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.424934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.426431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:42.426786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.429183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:42.444271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 273/562] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:42.445614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.522729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 290/563] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:42.524263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.663011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205710-d90a-4f69-8195-b4690e60afa3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.720217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdea25b-4964-4790-a132-a6bde3097506 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.737613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.739405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.739873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.740337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.755881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.758752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:42.782040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:42.783851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 274/564] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:42.786208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.788870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.790224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.790943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.791626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.793454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:42.794210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.798389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d684bc-5822-446c-989f-7579c2667ab8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:42.804747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.819302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 291/565] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:42.822740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff569-4b2c-4cbc-a29a-47b1ba1ef3f2 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.823546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff569-4b2c-4cbc-a29a-47b1ba1ef3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.824689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff569-4b2c-4cbc-a29a-47b1ba1ef3f2 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.828380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 292/566] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:42.832278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff569-4b2c-4cbc-a29a-47b1ba1ef3f2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:42.874016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.933183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f046b-e36f-42cd-bd86-1ffa4f874809 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.974854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:42.975582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.976034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.976486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.990954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:42.991220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff569-4b2c-4cbc-a29a-47b1ba1ef3f2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:42.992615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:43.009578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:43.011640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:43.013476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:43.013476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:43.013476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:43.013476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 275/567] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:43.013476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.037977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.038723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.039077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.039911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.040284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.040650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.042420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf1681-8fdc-4f4c-90c3-0b4e8195d4f9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.071217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 293/568] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 23 22:08:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.071217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.071217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.071217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.085032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.089876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:43.091617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:43.148371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb30f-ab11-48eb-9583-bbb69a749c45 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.208933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 294/569] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:43.208933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.209311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.209311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.209311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.209311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.215290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.216030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.217257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:43.239086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:43.241781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 276/570] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:43.243446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.371292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa568db-64fa-4a64-bbd6-947136ef255e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.403074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.410800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e076f-0430-40ef-a6ee-1e10b393d9d0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.425991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.426825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.427192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.427641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.428622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.429330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.431722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.450858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 277/571] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.453088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.472489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.473604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.474077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.474546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.496007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:43.505780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:43.507644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 295/572] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:43.510299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.590704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.621284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6d83-b3fa-4d8d-844b-901e7b044a2a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.650292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4aba5-e169-4701-b35b-aa4cdceb620e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.684337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.685442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.685914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.686370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.697503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.698840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.699212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.699584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.700448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.701339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.703114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.704625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.707317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.719942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 296/573] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.719942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:43.738122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:43.739932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:43.742129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:43.742129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:43.742129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:43.742129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 278/574] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:43.742129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.793987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.891279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94658b-265a-4468-a4ac-dcfaf43385f3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.906408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c7876-4c9c-4d6d-a85d-9bbe8b80021e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.945813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.946735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.947723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.948164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.948614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.949748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.950228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.952500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.960592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.961691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.962239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.962710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.973014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 279/575] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.973014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.978056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.980739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:44.003567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:44.005326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 297/576] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:44.007012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.125593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:44.137972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad6e5-959e-4cad-84be-f324c0434f5f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.147758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e58a6f-a88b-4689-8bc1-f1c37c86bde5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.198671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.199196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.199771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.199978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.200285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.200446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.200775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.200973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.201729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=783f430a59254acfbb4a7af3bb69b472) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:44.202140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:44.203950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.212066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 298/577] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/role_assignments?user.id=783f430a59254acfbb4a7af3bb69b472&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:44.213516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.234988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:44.246595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:44.248471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 280/578] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:44.250289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.332344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:44.435013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c55a5-8d8e-43c6-8ece-7aa89d36623b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.459673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bf43f-c1d5-40b5-99c5-d33d6036bcf1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.501140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.502461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.502955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.503440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.504643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:44.505211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:44.507805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.534568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.535419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.541150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.541320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 299/579] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:44.541409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.541508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.555827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:44.557932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:44.577931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:44.581676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:44.583297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:44.583297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:44.583297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:44.583297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 281/580] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:44.583297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.600009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:44.714689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f815a-2783-4b99-a7b8-f2da126ab09a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.744417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:44.750001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8813c-f446-42cd-8cbb-09b4eaeeeb62 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:44.787877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.789007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.789479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.789760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.790608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:44.790913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:44.792410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.805459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:44.806518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:44.807021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:44.807488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:44.809201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:44.809530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:44.810932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:44.815996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 300/581] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:44.817501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.828995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 282/582] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:44.831564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:44.954687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:45.004258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1691c10-3331-4fa9-ac9c-acc4ecd273f6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.012247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdcb6d-3f39-433f-a230-2659dfcfc89b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.059118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.060122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.060557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.061039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.072411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.073381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.074119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.074572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.074967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.075249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.075882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:45.076272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.077808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.092361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 283/583] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:45.093247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:45.098368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:45.099301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:45.100185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 301/584] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:45.102162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.146704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:45.251114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff832a98-6f2f-4e54-bebf-4dd128c5e507 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.251852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36c087-71ed-42c8-bb8a-9dbb2894ea90 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.292161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.292799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.293105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.293395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.303514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:45.306669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.308243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.320371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.321489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.321991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.322453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:45.333844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:45.334862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:45.335745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:45.335745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:45.335745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:45.335745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 302/585] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:45.336564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.351723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.354346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:45.377530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:45.378995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:45.379903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:45.379903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:45.379903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:45.379903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 284/586] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:45.380867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.492027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:45.511835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73872633-b16b-47e2-8bd3-3d3c5b17a5ff None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.515918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfc4b1-944a-4e8f-b723-ea05cfaa013a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.555077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.555758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.556106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.556354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.557029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:45.557327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.558794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.564624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.565836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.566312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.566773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.572922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 285/587] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:45.575228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.581586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.584044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:45.598516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:45.600373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 303/588] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:45.603761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.655180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:45.747326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047488e-8224-4fce-be77-542d384e87ae None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.766309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc6852-4aeb-44d2-823f-3301afb32ac0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:45.809303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.811028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.811979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.812562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.815206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:45.815464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.819325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.825030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:45.826129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:45.826620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:45.827108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:45.828346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:45.829168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:45.832285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:45.850444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 286/589] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:45.851860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.853781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 304/590] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:45.854508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:45.857890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.037304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa013d-33e6-4bc3-848a-bb6b31fef388 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.043440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.047304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1671dce-162a-4edd-a894-a2e6a5c17873 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.104779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.106101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.106630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.107180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/ee0b9bc7e5fa4b0d9f67ea235dae32a6/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.108399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.109377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.109919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.110450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.112606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:46.113046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.114910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.138142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=ee0b9bc7e5fa4b0d9f67ea235dae32a6, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.141167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.151989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 305/591] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:46.153663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.172644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 287/592] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:45 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/ee0b9bc7e5fa4b0d9f67ea235dae32a6/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:46.174627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.304053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.380159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d679-d491-4fa1-b1d9-340b90faa148 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.405041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94645-e840-48d7-b907-2f912d26fc4d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.440678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.441813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.441813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.442297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.452051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.454047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:46.477862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:46.479975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 306/593] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:46.484305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.492389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.493292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.493692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.494064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.502779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.504558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:46.517701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:46.520547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 288/594] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:46.523186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.557473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.671472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32498e-a95c-4f25-8896-49910b28eebb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.715415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee363c7-1b9d-4885-9700-63dc497a31db None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.751189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.755652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.756281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.756551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.756894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.757653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:46.758347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.759572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.777774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.778887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.779368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.779850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.786195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 289/595] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:46.786195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.809982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.814701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b96f4cc3-88f5-446f-a8b1-6cacdd6b8555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:46.846226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:46.848145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:46.850017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:46.850017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:46.850017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:46.850017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 307/596] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:46.850507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92fe95-d7f8-4572-91cb-1fb1ee130f1c None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.850507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92fe95-d7f8-4572-91cb-1fb1ee130f1c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.850752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92fe95-d7f8-4572-91cb-1fb1ee130f1c None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.852990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 308/597] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:46.854894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92fe95-d7f8-4572-91cb-1fb1ee130f1c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:46.884115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:46.932440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ccbd5-2d98-436b-8c5b-976bf23e8d04 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:46.988712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:46.989666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:46.989940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:46.990208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:46.990936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:46.991244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:46.993100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77e18-a6d5-4616-97cf-c2817fb5b66e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.019432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 290/598] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:47.019432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.019432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.019432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.038449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:47.040159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:47.051138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92fe95-d7f8-4572-91cb-1fb1ee130f1c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:47.121038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:47.122561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.123069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.123542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.146433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:47.149386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.175796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 291/599] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:47.177349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:47.183278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:47.185242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:47.187017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:47.187017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:47.187017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:47.190878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 309/600] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:47.192519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:47.244181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:47.301737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:47.406325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2745cc-8cfa-4f22-a3de-f6aafa368f8c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:47.425173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803c463-06b9-43e3-9a60-b40af5927a31 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:47.488795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:47.490380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.492934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.493631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.495138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:47.495890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:47.498725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.499939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:47.500998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.502012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.502449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.526401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 292/601] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:47.529158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:47.538748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=c21fbe153d904a19be3b27c499c4f88e, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:47.541526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.568213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 310/602] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:47 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:47.569984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:47.757510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:47.771142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f3069-eed8-481c-9e04-99ba5a3f5e76 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:47.803480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bd2d8-f588-4948-8ef3-77f826a0d0c7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:47.811281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:47.855456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:47.856645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.856941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:47.857548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.858042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.858165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:47.858568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:47.859052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:47.860224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:47.861441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:47.865226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.868989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:47.870870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:47.885390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:47.886370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:47.887251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:47.889803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 311/603] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:47.890924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:47.893930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 293/604] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:47.901160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.073566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6fb39-7b29-4300-8e4c-5df72533ee29 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.080570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9f2cb-2a88-43b4-a73b-37b2daddaa57 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.129620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.130645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.131134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.131610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.132536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:48.133093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.134864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.154982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.154982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.154982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.154982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.155605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 294/605] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:48.156763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.159466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:48.188114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:48.205456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:48.206759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:48.207692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:48.208352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 312/606] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:48.213472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.221738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:48.327116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3074d-d6ad-4edb-b0b2-8aa346041cdb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.384049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.385211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.385211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.385496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.395583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.396388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2bddc-95c2-486d-8dc0-068c1f1eefe1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.401087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:48.427415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:48.429381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 295/607] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:48.431434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.457819 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.458660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.459083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.459462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/76d8c7621f2a472ca879b60d7340edc8/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.479193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=76d8c7621f2a472ca879b60d7340edc8, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.480873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.504961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 313/608] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:48 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/76d8c7621f2a472ca879b60d7340edc8/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:48.506223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.580001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:48.648622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a943f3c-c6f3-49b6-9989-7dfa8af75369 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.673501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:48.691423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.692101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.692390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.692670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.693464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:48.693616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70997e1-4a9b-4511-8629-6e2abe89500b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.693769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.695237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.710255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 314/609] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:48.720762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.841637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.842606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.843097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.843571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.844891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:48.845925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.848420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.867282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 296/610] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:48.874081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:48.889577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae98e2-53c5-447a-bbeb-be46b1df8b27 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:48.893307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:48.946838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:48.947523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:48.947815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:48.948097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/3675dd6a15f146f69ce8ffd72fff2999/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:48.973537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=3675dd6a15f146f69ce8ffd72fff2999, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:48.975017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:48.996585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 315/611] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:48 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/3675dd6a15f146f69ce8ffd72fff2999/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:49.086115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bcbc1e-fb84-4686-a6fb-54adcd4e1d70 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:49.179770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:49.180794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:49.181320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:49.181776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:49.211544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:49.214548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:49.243823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:49.244864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:49.245776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:49.245776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:49.245776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:49.246457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 297/612] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:49.253242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:49.426550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce054e-e8da-400d-a96c-240b80a650e7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:49.511357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:49.511357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:49.511357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:49.511357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:49.512445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:49.512905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:49.515553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cafd81-3831-4188-8df5-23f13033c321 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:49.546774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 316/613] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:49.553713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:49.569260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5578e-ad55-48f5-b288-cab164e33f03 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:49.569718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5578e-ad55-48f5-b288-cab164e33f03 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:49.570199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5578e-ad55-48f5-b288-cab164e33f03 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:49.573990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 317/614] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:49.587496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:49.587947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:49.588423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:49.601219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:49.649285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:49.651425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:49.680382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:49.865848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f75b-9058-4688-bc45-a5b8e7eb58d8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:49.883658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 318/615] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:49.949214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:49.950238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:49.950694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:49.951151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:49.966297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:49.969096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:49.998542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:49.999583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:50.000529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:50.001105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 298/616] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:50.011080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:50.223680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543a925-9927-4a7c-9553-6939c79075d2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:50.300122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:50.301155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:50.301620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:50.302159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:50.303555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:50.304076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:50.306813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:50.347198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 319/617] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:08:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:50.356567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:50.380975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:50.385595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:50.613222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:50.640874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f8544-6694-4142-bee9-28dbc9d459fd None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:50.711061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb117b-25b5-4464-8b6a-2d1d44d9cd03 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:50.735109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:50.736800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:50.737325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:50.737810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:50.757852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:50.759008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:50.759538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:50.760042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:50.765240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:50.775029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-28613726-3d2d-4546-8d35-8ee19150e6dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:50.776650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:50.777708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:50.778608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:50.779543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 320/618] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:50.780651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:50.781512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29d20-30bb-4ca1-93a6-248bbe15bd24 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:50.781981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29d20-30bb-4ca1-93a6-248bbe15bd24 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:50.782578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd29d20-30bb-4ca1-93a6-248bbe15bd24 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:50.787455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 321/619] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:50.788839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29d20-30bb-4ca1-93a6-248bbe15bd24 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-2f64767f-25f9-4621-a13d-b16907878be0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:50.801394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:50.802504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:50.803427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:50.803427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:50.803427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:50.805655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 299/620] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:50.807164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:50.807661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:50.808111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:50.828968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:50.831683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:50.912735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 300/621] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:50.914400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:50.937213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:51.023176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd29d20-30bb-4ca1-93a6-248bbe15bd24 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.044628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:51.147952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafc1e9-ac0c-4cf3-a8f4-609fd9eda0fc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.150253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:51.151335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:51.151783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:51.152350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:51.156900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:51.156900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:51.156900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:51.187045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 322/622] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:51.195572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:51.268390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:51.268722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:51.269014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:51.269464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:51.270627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:51.271155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:51.273730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:51.318782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 301/623] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:51.333309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:51.412546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae77c4-dce2-4865-8fa0-d579f6dfe7f0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.464119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:51.488889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:51.492029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:51.492789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:51.493498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:51.518522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:51.521550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:51.552041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:51.553952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:51.555694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:51.555694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:51.555694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:51.559049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 323/624] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:51.561072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:51.640677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd13ac0-8042-4fa2-8dfd-17a5dbd6aa8e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.669428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:51.711749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:51.712755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:51.713269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:51.714391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:51.729337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:51.731872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:51.756914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:51.758663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:51.760368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:51.761262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379a2e8-05f4-4f7f-aa80-be73a158ff7a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.764744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 302/625] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:51.766713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:51.832015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:51.833057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:51.833587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:51.834048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:51.853344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:51.863278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:51.865359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 324/626] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:51.867475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:51.935025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:51.944632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45504fcf-2236-42f4-9aca-f1484b37ed2e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:51.999379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.000334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.000858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.001850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.003199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:52.003750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.006352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.026919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9be8-d741-4706-b861-6429681f99f1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.038520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 303/627] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:52.039792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.070475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.071625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.072136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.072653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.073818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:52.074330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.076381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4371d-a1c1-4753-aa37-15ca5d102101 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.093008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 325/628] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:52.095065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57296-f59e-4576-a9f1-ebdb70e9825b None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.095563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57296-f59e-4576-a9f1-ebdb70e9825b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.096146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57296-f59e-4576-a9f1-ebdb70e9825b None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.102456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 326/629] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:52.102456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57296-f59e-4576-a9f1-ebdb70e9825b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.105074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:52.190703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1466-8733-4cda-9342-670f028b31da None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.248488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.249637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.250086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.250585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.252561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:52.253146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.255807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.265392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:52.270888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 304/630] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:52.271945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.281703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57296-f59e-4576-a9f1-ebdb70e9825b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.336291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.337074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.337416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.337706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.347248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.348702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b3155a46-ed57-4ade-9a88-e5613a68013f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:52.361158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:52.363007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 327/631] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dcc0-0e28-4cd6-87cc-01db5973bc69 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.364885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dcc0-0e28-4cd6-87cc-01db5973bc69 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.366294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7dcc0-0e28-4cd6-87cc-01db5973bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.385841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-01b7dcc0-0e28-4cd6-87cc-01db5973bc69 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:52.387060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-01b7dcc0-0e28-4cd6-87cc-01db5973bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:52.437484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:52.448803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a879dc-693d-45eb-90f3-fc00f644f1bd None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.508484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 328/632] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:52.509555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.509860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a685-7e27-4556-8633-68ffb7018deb None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.510229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a685-7e27-4556-8633-68ffb7018deb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.510477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26a685-7e27-4556-8633-68ffb7018deb None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.510860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.511250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.511700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/783f430a59254acfbb4a7af3bb69b472/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.516555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 329/633] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:52.518679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26a685-7e27-4556-8633-68ffb7018deb None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.534910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=783f430a59254acfbb4a7af3bb69b472, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.536517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.564855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 305/634] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:52 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/783f430a59254acfbb4a7af3bb69b472/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:52.564855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.706722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:52.745294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26a685-7e27-4556-8633-68ffb7018deb None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.803666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06575-a385-446a-80f1-2e50f74f99b6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:52.820303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.821351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.821914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.822354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.840443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.842183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-fcb305bf-5de3-44d1-9f42-9038e2eb5c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:52.863502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:52.865694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 330/635] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.867744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.888483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:52.889020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:52.889660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:52.890163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:52.890372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:52.890783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:52.893607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:52.893925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:52.897186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:52.933172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 306/636] 10.222.0.69 () {56 vars in 1139 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:52.934870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:52.942436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:52.990081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 331/637] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:52.991002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.093782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.128996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df88d43-97b9-42c0-9b16-465032aa70ca None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.153018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f2b25-75b9-4521-94c6-401e2ac1215a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.170645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.171277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.171551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.171823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:53.227862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.229260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.230378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.230859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:53.232351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:53.233096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:53.237287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:53.258134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:53.259752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:53.269720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 307/638] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:53.269720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.350302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.395834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06256b-5d1a-4b5c-ad44-0849d456ba3b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.396089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.442286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.443241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.443683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.444125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:53.457954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:53.463562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:53.464607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:53.465578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:53.468154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 308/639] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:53.469371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.478927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 332/640] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:53.484847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.616617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dc151-e541-4cef-9ce7-0b5113d33c17 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.662275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.680231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.681333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.681805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.682241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:53.693626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394052d-5628-48a9-ae02-6a5a3fcff93b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.697330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:53.700318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:53.724690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:53.726472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:53.728053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 309/641] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:53.728787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.757293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.758032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.758330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.759108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:53.759822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:53.760123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:53.761808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:53.778017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 333/642] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:53.779863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:53.824354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.917475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae505b57-f75f-4b24-878c-b2aed45e4a7f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.971332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f5431-baa1-4948-b8b9-59753ea143e0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:53.984561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:53.986617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:53.987273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:53.987944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.009268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:54.012488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:54.026869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:54.027940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:54.029081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:54.029566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:54.041358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:54.043235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:54.045881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:54.045881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:54.045881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:54.045881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 310/643] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:54.045881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.058535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:54.069286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:54.070981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 334/644] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:54.075602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.130126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:54.266483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9753-7eb9-4110-9d75-6f647c52e991 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:54.281487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:54.302112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaadcf-8749-4a71-bb07-a28c36bec8e9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:54.336524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:54.337757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:54.338368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:54.338946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.340547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:54.341201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:54.344108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:54.375853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:54.377765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:54.378105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:54.378449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.391315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 311/645] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:54.394643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.403614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:54.408219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:54.439396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:54.441268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:54.443056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:54.443056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:54.443056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:54.443056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 335/646] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:54.443056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.603002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:54.616941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c933af-1dab-4ce1-9563-a34fe838a04d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:54.637237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e2fc-8bdf-4efa-9ebe-60da720a3c9b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:54.687882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:54.689623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:54.690410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:54.690991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.692315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:54.693026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:54.695481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:54.710500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:54.711765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:54.712328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:54.712920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:54.714072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:54.714685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:54.717219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:54.719836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 312/647] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:54.723424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.733548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 336/648] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:54.735188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:54.742603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:54.936424 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d27a4-1170-4fef-985c-3574b4b5375b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:54.937123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70f4d3-0868-485a-98fe-74dd32732f9f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.007001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.007871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.008280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.008670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.009664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:55.009866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.010114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.011129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.011742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.012244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.012461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.037404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 337/649] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:55.038965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.066682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:55.163616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.166382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.176327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:55.262124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ba5ec-aec1-480e-b6dd-6e24b9909da3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.335222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.336524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.337181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.337730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.352788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.355739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.367386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 313/650] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:55.369245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:55.381942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:55.383716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:55.385537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:55.389909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 338/651] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:55.392331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.490516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:55.557586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2104e-cea9-460a-9982-637ad2297db7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.604401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.605111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.605393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.605669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.607021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e234-1b3a-4578-90fb-f811e2643b3b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.618996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.620839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.639187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:55.639642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:55.640564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:55.641506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:55.641506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:55.641506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:55.641506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 314/652] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:55.642374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.661799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.662462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.662759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.663030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.671794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.674114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:55.687965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:55.690478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 339/653] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:55.691811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.794603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31076b8e-b45d-4d08-b9b9-f52e5e1a1487 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.802412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:55.806852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213e5ae-12f8-48d8-a228-7b31082515e1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:55.843452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.844431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.844953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.845452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.846764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:55.847693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.848209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.848652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.849738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:55.850244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.852551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48c4f-e729-422b-8395-b0def9cd36ce None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.863822 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:55.866463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:55.870005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 340/654] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:55.871600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d695-cd41-4a4e-8ac6-fead7428518a None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:55.871964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d695-cd41-4a4e-8ac6-fead7428518a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:55.872323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970d695-cd41-4a4e-8ac6-fead7428518a None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:55.879219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 341/655] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:55.879219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970d695-cd41-4a4e-8ac6-fead7428518a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:55.895076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:55.897252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:55.899008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:55.899008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:55.899008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:55.899008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 315/656] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:55.899008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:55.953617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.033806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970d695-cd41-4a4e-8ac6-fead7428518a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.072390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147a72e-40d8-4f5d-a0c9-26aabad4c5a1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.090836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.091861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.092299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.092730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.093955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:56.094333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.097306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.116318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.117114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.117491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.117854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.118443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 342/657] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:56.118905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:56.119311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.119675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:56.121153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e33492-6d9b-4b04-933a-e136139e5177 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.145302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 316/658] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:56.146901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.147460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.148331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.170990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:56.172780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:56.189532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.264701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 317/659] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:56.265990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:56.306617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782d895-287e-452c-9369-fa8d78035525 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.312161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.377225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.378274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.378558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.378972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.380235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=ee0b9bc7e5fa4b0d9f67ea235dae32a6) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:56.380750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.383255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.405252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 343/660] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:56 2022] GET /identity/v3/role_assignments?user.id=ee0b9bc7e5fa4b0d9f67ea235dae32a6&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:56.406425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:56.428400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8be888-0d8e-4924-b305-1c0574f05f17 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.523362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.525836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.526823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.527556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.529385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:56.530904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.537079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.558100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 318/661] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:56.559498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:56.572906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.619117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6424ab6-6a34-481e-9585-2c73c03bc12b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.682595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.683556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.683994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.684429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.697726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.700048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:56.720668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:56.722344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 344/662] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:56.723348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:56.737100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394e032-2d7b-49ca-9496-5d988d8e396a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.781786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.783199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.783901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.784200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.785359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.902013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddd93f-a9e7-47aa-bcd1-87ac477f0370 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:56.907892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.909995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:56.919298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:56.975273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:56.976218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:56.976685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:56.977215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:56.990015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:56.991628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:57.004302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:57.006026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 345/663] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:57.007687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.069784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 319/664] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:57.072558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.164425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.189101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96924dd-020b-4b6c-b5ee-40ab6177ef6d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.217639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111475e-9110-4617-9523-a8b3edc5fd1b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.229243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.241035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.242382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.243054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.243587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.244598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:57.245174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:57.247472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.270219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.271192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.271774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.272210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.280905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 346/665] 10.222.0.69 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:57.281905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.295147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:57.302968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:57.304198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:57.305513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 320/666] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:57.306243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.428089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe9706-aba3-4d23-992a-f9684b84a86f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.445291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263c15-dc9d-45dd-85d1-000797e03c0f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.472008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.472730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.473113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.473579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.474363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:57.474672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:57.476173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.491734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 347/667] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:57.492253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.503582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.519375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.520440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.520984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.521444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.540164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:57.542992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:57.572154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:57.573442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:57.574579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:57.574579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:57.574579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:57.574579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 321/668] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:57.576045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.602055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.626961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785f68-9e86-456a-8ed4-64c1863c6c5d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.670778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.671396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.671674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.671957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.706630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c43a68-6f2d-4027-a228-fe08da2a542a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.754467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.755142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.755465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.755787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.756669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:57.757056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:57.758789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.768489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:57.769861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 322/669] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:57.770647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:57.771257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.786999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.909684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:57.945435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 348/670] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:57.946414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d918a0-2498-4fa1-8bd3-17dc3e72cc2a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:57.946897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:57.996663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:57.997619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:57.998029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:57.998447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:57.999581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:58.000075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.002360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.009470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 323/671] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:58.009966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.141555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd64a7-d04a-4c4d-a081-2ff88b24a4a6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:58.152184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:58.192746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:58.193221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:58.193503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:58.193777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:58.194547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:58.194859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.196402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.216853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 349/672] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:58.216853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.248865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a4044-b611-4a27-8b54-fa741beb54b1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:58.326003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:58.326653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:58.328079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:58.328079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:58.349730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.351809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.356373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:58.378881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:58.381068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:58.382913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:58.382913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:58.382913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:58.382913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 324/673] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:58.386891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.423823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973ed1b-c204-4ea8-a676-25ae0e384de2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:58.507643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:58.510089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:58.510591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:58.511135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:58.545644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.550298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:58.588237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:58.590099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:58.591825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:58.591825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:58.591825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:58.596988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 350/674] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:58.599080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.641541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:58.663152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ae672-a33f-4683-9648-d36fc7067a3d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:58.737052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:58.738204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:58.738666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:58.739111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:58.754057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.756443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:58.781566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:58.783040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:58.784554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:58.789328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 325/675] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:58.790870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.819999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc8461-4ddd-4897-9ab5-2643b080d44d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:58.871374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:58.871950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:58.872233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:58.872507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:58.873207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:58.873512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:58.874964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:58.893604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 351/676] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:58.894565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:58.911928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:59.007742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250ff7-607f-4f0f-9749-2f05de02906d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.030559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:59.081002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.082231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.082795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.083353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.084630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:59.085320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.085662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1138d0-8f6c-4fa6-93e1-b6ecde9c4f1c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.088128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.117204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 326/677] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:59.119660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.165055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.166510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.167258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.167970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.169752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:59.170621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.174116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.201213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 352/678] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:59.203138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.340020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa73b-ea30-4f2a-b886-2b49a9177757 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.375657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:59.419787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.419787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.419787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.419787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] PATH_INFO: `/v3/users/swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.434055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.436791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.439620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6580-a322-4ac6-bc43-cc4cdcbca2ca None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:59.461482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:59.463340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:08:59.465225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 327/679] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:59.466363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.534652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.537212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.538204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.539083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.554113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.557641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.561680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:59.585693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:59.587449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:59.589256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:08:59.593748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 353/680] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:59.596272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.691163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2c8fa-3066-4d8f-ab4a-6a3dc1e93cac None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.759952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.760996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.761496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.761984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.763367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=76d8c7621f2a472ca879b60d7340edc8) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:59.764245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.767560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.780178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 328/681] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/role_assignments?user.id=76d8c7621f2a472ca879b60d7340edc8&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:59.781856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.799164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b170c-8892-46be-a4a9-ae41dfa24b00 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:59.869131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:59.870834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:59.871649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:59.872450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:59.874267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:59.875411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:59.879158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:59.891469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:59.920086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 354/682] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:59.927659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:59.983784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc03b9-80db-4fd5-87b6-7999a298bbb4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:00.028150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:00.028799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.029122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.029389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.030154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:00.030512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:00.033140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fd330-103c-4aa5-9789-d190ef4769df None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:00.056867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 329/683] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:00.056867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec48f5-614a-4fa1-8f4c-5aeae3b2f5af None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.056867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec48f5-614a-4fa1-8f4c-5aeae3b2f5af None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.056867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec48f5-614a-4fa1-8f4c-5aeae3b2f5af None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.056867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 330/684] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:00.062204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec48f5-614a-4fa1-8f4c-5aeae3b2f5af None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:00.076690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:00.147147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee093bd-3892-48aa-a6b4-c552e938754f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:00.210894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:00.211975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.214623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.214623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.272582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:00.280070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec48f5-614a-4fa1-8f4c-5aeae3b2f5af None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:00.331253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:00.332199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.332656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.333154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.334532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=3675dd6a15f146f69ce8ffd72fff2999) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:00.335042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:00.336613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11a93b-e569-42d0-86a5-93fe6b04ba37 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:00.343898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 331/685] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:00 2022] GET /identity/v3/role_assignments?user.id=3675dd6a15f146f69ce8ffd72fff2999&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:00.345571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.345856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.346121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.369549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:00.371149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:00.376838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:00.379946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c6a2-9694-466e-b611-cd5295335007 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:00.481635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:00.566972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 332/686] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:09:00.590254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 355/687] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:09:00.598943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:00.748890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45695d-0676-4bfb-a11b-673c221849c9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.749527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45695d-0676-4bfb-a11b-673c221849c9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.750056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45695d-0676-4bfb-a11b-673c221849c9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.754810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c26bb-466a-4f39-adce-bb94ff97000b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:00.757523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 356/688] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:00.758984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:00.766737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.770072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.770072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.807152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:00.809348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:00.859495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:00.859495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:00.859495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:00.859495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:00.885735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:00.890112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:00.945472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:00.947774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:00.949726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:00.949726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:00.949726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:00.949726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 333/689] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:00.956397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.043673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 357/690] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:09:01.114035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.322347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5627f7-95a9-46f1-91f1-95a0b2248519 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:01.373459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:01.396260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f0d6-dedd-4289-9624-dd5429afc142 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:01.429987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:01.431034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:01.431524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:01.432028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:01.433275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:01.433826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:01.436630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:01.459886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:01.460950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:01.461229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:01.461502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] PATH_INFO: `/v3/services/network` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:01.462129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:01.463599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:01.477741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 334/691] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:01.486543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:01.489645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:01.491045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:01.492015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:01.495339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 358/692] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:01 2022] GET /identity/v3/services/network => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:01.505266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.516027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:01.746314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22445-8ab1-430a-969f-091b4083fd7e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:01.763400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e326-c657-4cbd-adc0-26fad8fc7b81 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:01.808290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:01.810552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:01.811591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:01.812341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:01.824619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:01.825294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:01.825661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:01.825935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:01.826844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:01.827154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:01.829046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:01.830422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:01.833800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:01.835845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 359/693] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:01.836703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:01.857934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:01.859634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:01.861956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:01.864118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:01.868233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 335/694] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:01.871255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:01.991916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6620b-4aff-4747-a5ed-11225f1acbd1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.008331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:02.062719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceae453-6383-481d-b903-f5ebdf12defa None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.083973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.085473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.085782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.086050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.102327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:02.107975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:02.109812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 360/695] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:02.112401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:02.143022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.144790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.145708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.146422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.148579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] RBAC: Adding query filter params (type=network) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:02.149355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:02.153223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:02.171342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 336/696] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:02.173809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:02.237587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:02.307764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50458a5e-f4f9-4408-ba78-4637e0829ff1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.348369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e3c2a-9529-4d99-98a6-578ad905cc2f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.391459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:02.402534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.402785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.403678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.403932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.404109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.404495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.405232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.405784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.406971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:02.408196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:02.410533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:02.414059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:02.414631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:02.418286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:02.428852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 337/697] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:02.434313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:02.468946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 361/698] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:02.479250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:02.578029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18c3a8-4206-44bb-9fc7-05af3767b812 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.625745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.627310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.627595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.627870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.649280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:02.651612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:02.678655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:02.680323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:02.681748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:02.681748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:02.681748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:02.684960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 338/699] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:02.690540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:02.781543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379234-5804-42f8-9033-f57f99f88056 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:02.885335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:02.893546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:02.897507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:02.897978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:02.898455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:02.901620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=783f430a59254acfbb4a7af3bb69b472) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:02.902158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:02.905991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:02.913198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:02.931355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 362/700] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:02 2022] GET /identity/v3/role_assignments?user.id=783f430a59254acfbb4a7af3bb69b472&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:03.032331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac59d-09a9-4064-b713-b8494273ce5b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:03.119290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:03.120310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.120788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.121292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.122435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:03.122949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:03.125560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fda0c-db1e-41f3-980a-4f9597bf62fb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:03.158954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 339/701] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:03.168775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:03.308960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6fe4-9b87-46da-8874-0eefbfff9fd7 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.309430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6fe4-9b87-46da-8874-0eefbfff9fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.309865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac6fe4-9b87-46da-8874-0eefbfff9fd7 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.312449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 340/702] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:03.322811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.323259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.323716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.365829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:03.367817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:03.392125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b04009-8833-491c-ab7a-d8a6a0852bb2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:03.450590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:03.451408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.451691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.451966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.467594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:03.469127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:03.484626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:03.487064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:03.489675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 363/703] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:09:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:03.493637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:03.530224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 341/704] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:09:03.587426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:03.651529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25db77-0c73-4385-a1f1-e9964ce991cb None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:03.700315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:03.700881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.701145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.701426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.702289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:03.702596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:03.705719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e235e5-56be-4ff1-98f3-75cb8530eabd None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:03.731007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 364/705] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:09:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:03.739767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:03.788398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:03.878720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b333-ed52-4800-975e-8c8a22174263 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.879255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b333-ed52-4800-975e-8c8a22174263 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.879663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b333-ed52-4800-975e-8c8a22174263 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.882178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 365/706] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:03.901932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5cb3a-5ca6-4ec8-9da4-1a426212b606 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:03.908219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.908474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.908898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:03.944618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:03.946614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:03.994684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:03.995444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:03.995726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:03.995998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.092326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 366/707] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:09:04.094051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.151546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.156143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.238931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:04.240717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:04.317407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a15b1-0b72-4fce-808f-bef542f67554 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:04.397299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:04.397299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:04.397299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:04.397299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.397885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 342/708] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:09:04.406427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.410433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.412369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:04.433975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:04.435363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:04.436842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:04.436842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:04.436842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:04.439711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 367/709] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:04.446459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.593567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:04.601933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4810b3-a0fc-4422-8fa2-66c7dabeadc4 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:04.604013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f279f-3a81-4c40-939f-41f93e96ccf2 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:04.650417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:04.651449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:04.651928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:04.652412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.653250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.655148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.666677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:04.667584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:04.668012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:04.668421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:04.669400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:04.671194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:04.672389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 368/710] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:04.674293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.676408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:04.689912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.691688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:04.710643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:04.711780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:04.712738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:04.712738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:04.712738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:04.714635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 343/711] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:04.715700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.841165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb065a9-3771-4fed-8f18-f16107ae8245 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:04.857443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e52ab-ab6a-47df-9392-e15c4bedc25a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:04.880575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:04.881502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:04.881925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:04.882341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.883152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:04.883711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.885590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.897079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 344/712] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:04.898274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.902922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:04.903505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:04.903505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:04.903662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:04.904305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:04.904611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:04.906069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:04.929294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 369/713] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:04.930222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:04.958919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:04.970956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:05.020385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412af7-d711-4b2d-9fee-6cf024afe5bb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:05.069728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f22c-9040-455d-9f4f-8d921c67fad6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:05.084154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:05.085539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.086216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.086913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.088294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:05.089138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:05.091925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:05.113981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:05.114557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.114836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.115112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.115946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:05.116114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:05.116589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 345/714] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:05.117529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:05.118352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:05.133321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 370/715] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:05.134367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:05.323285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:05.328179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ecdb4-528d-489d-9fa3-0c7171e8e625 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:05.364575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90092f-eaa0-4617-87ad-af47aada91ce None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:05.364846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:05.459295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:05.460943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.461416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.461857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.467279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:05.468675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.469225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.469756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.470933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:05.472311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:05.475349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:05.475688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd0a64-bda5-496f-be53-7fb4f242bd43 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:05.503450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:05.505592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:05.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 371/716] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:05.514196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:05.523504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 346/717] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:09:05 2022] POST /identity/v3/users => generated 254 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:05.546318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ca20-034e-44b4-9443-27256683b48c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.546979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ca20-034e-44b4-9443-27256683b48c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.547549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5ca20-034e-44b4-9443-27256683b48c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.550549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 347/718] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:05.558649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.558998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.559367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.622890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:05.625088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:05.673756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3f993-5a7c-4292-b2d9-d5b81fe0c5a3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:05.718747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:05.720561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:05.721274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:05.721958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:05.723143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:05.723746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:05.726218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:05.757665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 372/719] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:05.771030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:05.790639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 348/720] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:09:05.829771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:06.027550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc4f5e-d271-4463-9e3c-0de72d344664 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:06.086403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:06.087110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:06.087474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:06.087749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:06.088671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:06.089010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:06.090826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c6719-b025-40d3-942b-32edaf22203f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:06.102829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 373/721] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:05 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:06.336230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:06.533415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:06.552927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619c15c-a94b-4c02-888b-8a2a2ce938cb None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:06.626456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:06.627020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:06.627294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:06.627563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:06.628244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:06.629784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2373d-dc36-4224-bd34-97522da5bf53 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:06.652182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 349/722] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:06 2022] POST /identity/v3/services => generated 240 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:06.760485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef358a-588e-492b-b12f-89dd9cfe4c25 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:06.761021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef358a-588e-492b-b12f-89dd9cfe4c25 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:06.761508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef358a-588e-492b-b12f-89dd9cfe4c25 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:06.764334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 374/723] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:06.773491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:06.773865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:06.774181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:06.803368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:06.804587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:06.907767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 350/724] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:06 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:09:07.442872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef358a-588e-492b-b12f-89dd9cfe4c25 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:07.599780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:07.695829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef358a-588e-492b-b12f-89dd9cfe4c25 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:07.764354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:07.765497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:07.765993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:07.766521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:07.790024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-13fc28d8-84e5-44e9-8472-1c5fb47cc3b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:07.800147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:07.801247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:07.802327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:07.803017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 375/725] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:07.810390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:08.039428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:08.079870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b6ae7-bb5a-4632-9fbc-20fc6c80b9b0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:08.176227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:08.176470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3655d9f-5bf6-4d4e-b08d-d1072a8e4e46 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:08.176650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:08.176650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:08.176799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3655d9f-5bf6-4d4e-b08d-d1072a8e4e46 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:08.176909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:08.176990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3655d9f-5bf6-4d4e-b08d-d1072a8e4e46 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:08.177065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:08.177065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:08.177065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:08.177256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 376/726] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:08.188973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:08.188973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:08.188973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:08.192400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 351/727] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:08.204851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:08.222740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:08.224384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:08.333724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37665a54-ed15-40ce-8291-9273381a6d77 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:08.379079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:08.380758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:08.381520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:08.381793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:08.399242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:08.400727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:08.409055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 377/728] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:08 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:09:08.410469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:08.429530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:08.430596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:08.431662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:08.431662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:08.431662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:08.439127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 352/729] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:08.445946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:08.618940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:08.708058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abc977-f77a-40a6-b1e8-fc78d1d4ae5b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:08.780066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:08.780693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:08.781000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:08.781275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:08.781932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:08.782867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:08.784337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:08.811999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 378/730] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:08.819122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:08.881326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:09.143322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c77b85-8d48-4265-8b6c-b00230c09eb2 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:09.192601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa027b9-a5b4-4a20-b406-bc7e0156664d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:09.210984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:09.211640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.211919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.212191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.223452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:09.226586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:09.228841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:09.244862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:09.245981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.246471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-c330c14f-3992-46df-97f9-a167edfa42b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:09.246714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:09.247649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:09.248772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 353/731] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:09.250268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.252346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:09.254341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74930fdc-d52a-49c0-9a4a-92d2a22c3a99 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:09.255497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b98e-b56c-431f-90cb-bae3f33ed40f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.255944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b98e-b56c-431f-90cb-bae3f33ed40f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.256230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30b98e-b56c-431f-90cb-bae3f33ed40f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.262373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 354/732] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:09.262373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b98e-b56c-431f-90cb-bae3f33ed40f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:09.288967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 379/733] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:08 2022] POST /identity/v3/services => generated 251 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:09.291082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7261-a5ef-4c45-a629-f7d754ce4019 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.291921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7261-a5ef-4c45-a629-f7d754ce4019 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.292571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7261-a5ef-4c45-a629-f7d754ce4019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.319069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-753f7261-a5ef-4c45-a629-f7d754ce4019 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:09.321270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-753f7261-a5ef-4c45-a629-f7d754ce4019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:09.395748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:09.435560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 380/734] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:09.473252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9caeaf-6cd3-4b5d-8100-433d3a82e9c6 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.473918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9caeaf-6cd3-4b5d-8100-433d3a82e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.473918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9caeaf-6cd3-4b5d-8100-433d3a82e9c6 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.476047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 381/735] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:09.485142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.485481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.485724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.509054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:09.510524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:09.524421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30b98e-b56c-431f-90cb-bae3f33ed40f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:09.594568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:09.596465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.596882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.597300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.598470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:09.598939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:09.601314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:09.614612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 382/736] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:09.638383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 355/737] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:09:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:09.645661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:09.720669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:09.775094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:09.887175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba260e-abe1-4c4a-bb76-37def580d1af None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:09.943647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:09.945080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:09.945536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:09.946222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:09.966975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c253439-b52a-4557-8736-31e6b42473ce None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:09.989460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.027406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.029164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.030126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.030885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.054981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:10.062300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:10.064017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-87dddfec-2364-4238-bc11-9e638f2ec96c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:10.066395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:10.068100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:10.069792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:10.074008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 356/738] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:10.076618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d058c-13b1-42a2-8de1-3c0a1dccef60 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.077381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d058c-13b1-42a2-8de1-3c0a1dccef60 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.078112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d058c-13b1-42a2-8de1-3c0a1dccef60 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.082676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 357/739] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:10.084829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d058c-13b1-42a2-8de1-3c0a1dccef60 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.114891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.221093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 383/740] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:09:10.222522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.251620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d058c-13b1-42a2-8de1-3c0a1dccef60 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:10.301540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.302577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.303059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.303545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.304769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:10.305366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:10.307927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760013d-a5d1-49b5-a2b0-7201feaf3926 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:10.323866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 358/741] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:10.326137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.326616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.327087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.357039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:10.359134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:10.374202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acf12a-1b09-41a7-ae0b-d5c72d8e19b8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:10.418866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.419543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.419823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.420101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.423780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.424416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.435290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:10.441602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:10.442647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:10.443497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 384/742] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:10.444202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.500866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 359/743] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:10.500866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.638085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bcbca-a257-4bb2-89f2-9bba489ffa5e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:10.689761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5572-b484-405b-8cc0-dd9af4c17853 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:10.714480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.715763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.716251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.716727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.733842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.734763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.735537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.735537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.739843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:10.742923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:10.749158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:10.754292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:10.770623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:10.772825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:10.775175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:10.775175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:10.775175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:10.775175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 360/744] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:10.776056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:10.785772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:10.794979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:10.794979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:10.794979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:10.795662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.795919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 385/745] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:10.795919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:10.798952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.889841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:10.915905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5e4af-8b89-40a1-990f-e68a0e9ed43c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:10.971238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:10.972436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:10.972436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:10.972436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:10.973156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:10.976840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:10.976840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:10.985806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 361/746] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:10.987720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.000628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d8b0-88ff-4d75-bde1-cb701ad5590a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.070629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.071418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.071819 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.072218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.073164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:11.073610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.075258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.091015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 386/747] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:11.091961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.115871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:11.155166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80f42-7c85-4971-9045-5d9506a83b32 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.220398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.222069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.222572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.223074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.224329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:11.224919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.227680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.259802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 362/748] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:11.259802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.266409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d1b66-e8e0-430a-b931-528fcf241294 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.281293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:11.329830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.330934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.331441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.331902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.352196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.355138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:11.378392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:11.380569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:11.382361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:11.382361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:11.382361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:11.382361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 387/749] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:11.382361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.463574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df29f-4998-4e09-ad26-e21a27b13956 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.525021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.525917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.526323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.526762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] PATH_INFO: `/v3/services/network` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.527528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.529224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:11.547434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:11.550095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:11.551758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:11.555643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 363/750] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:11.555643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.562636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:11.565193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1485-8d03-40f5-82df-c7994c6bfef2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.635234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.636097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.636458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.636866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.653370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.656026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:11.679606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:11.681508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:11.683375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 388/751] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:11.686193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.729724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:11.785721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bda7ac-cb4b-4029-9f00-d26df966d65f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.851179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.852308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.852766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.853187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.867761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.870626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.889149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cdecb-99cc-48dd-b6ff-8ae93962b3a9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:11.901050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:11.902801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:11.904578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 364/752] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:11.907806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:11.959987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:11.960743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:11.961178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:11.961563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:11.962557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:11.963002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:11.965162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:11.987590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 389/753] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:11.989546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.034376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.101480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f7ef-8b1b-4203-9592-861115a18fc7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.111577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.139535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13e316-82aa-4517-bd7d-dec1b9e0f75d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.150048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.151062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.151514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.151960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.153104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.153605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.156077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.165715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 365/754] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:12.166927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.197507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.198128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.198401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.198670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.199413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.199712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.201289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbae985-2d10-446d-a1d7-a3a4908b45f7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.222381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 390/755] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:09:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:12.223661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5bc0-1b6c-4a81-bcc4-4f87053555d5 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.223944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5bc0-1b6c-4a81-bcc4-4f87053555d5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.224212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a5bc0-1b6c-4a81-bcc4-4f87053555d5 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.228918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 391/756] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:12.228918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5bc0-1b6c-4a81-bcc4-4f87053555d5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.309272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3290b0f-6d64-47c8-babc-d44853814ee6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.341258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.352273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.353041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.353439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.353773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.354780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.355231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.356915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.362722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a5bc0-1b6c-4a81-bcc4-4f87053555d5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.371626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 366/757] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:12.372515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.412511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.413196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.413482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.413755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.425770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.427259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.429537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:12.442670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:12.443926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:12.444922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 392/758] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:12.445562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.517294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64867dd-e722-47a3-bbde-2ceb0e8414b0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.565264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.565889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.566166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.566437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.567169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] RBAC: Adding query filter params (type=network) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.567478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.568929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff1de-c689-4ae8-894b-5d838aef1093 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.575744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 367/759] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:12.577144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.577435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.577710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.600831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:12.603093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:12.621471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf63c57-730e-40fc-b481-3676abcd009c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.661932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.662955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.663286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.663643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.670657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.680339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.682014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:12.697800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:12.707482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:12.709465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:12.709465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:12.709465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:12.709465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 393/760] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:12.709465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.710092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 368/761] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:12.710092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:12.784526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:12.882086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17874438-ecc6-45be-8197-281f38aeec94 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.898996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680fbdf-dd1f-4814-9a7c-04860ea8b0e2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:12.962912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.963951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.964428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.964952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.966381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=783f430a59254acfbb4a7af3bb69b472) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.966813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.970128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.972885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:12.973964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:12.974519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:12.975036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:12.976415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:12.977019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:12.979875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:12.981856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 394/762] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/role_assignments?user.id=783f430a59254acfbb4a7af3bb69b472&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:12.983096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.017850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 369/763] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:13.019631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.089725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:13.177549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c55d06-0e60-4ead-8eb1-88d68cfea5ce None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:13.182525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11ae77-cd85-4c1b-8ec2-31967c8c6163 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:13.207804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:13.246310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:13.246618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:13.247308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:13.247431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:13.247796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:13.247899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:13.248285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:13.248398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:13.249497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:13.249639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] RBAC: Adding query filter params (interface=public, service_id=666d38f9cf4042afb326259fc5a14a1f, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:13.250014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:13.250133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:13.253417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:13.253621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:13.271489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 395/764] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:12 2022] GET /identity/v3/endpoints?service_id=666d38f9cf4042afb326259fc5a14a1f&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:13.271489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.290023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 370/765] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:13.290023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.481456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8661da-50e9-422d-81c7-7e98168cb99f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:13.489326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:13.494428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2cd6b-9f77-44c1-acf4-8d3d31c92243 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:13.536244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:13.537097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:13.537929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:13.538113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:13.538953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:13.540695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:13.548335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:13.548850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:13.549126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:13.549414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:13.555716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:13.557711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:13.560103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 396/766] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:13.563852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.626555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:13.641460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:13.643238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:13.724432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fab0-2957-45da-8edf-51febe9a3db0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:13.791450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:13.792358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:13.792639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:13.793054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:13.794088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:13.796437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:13.803867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 397/767] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:13.813702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:13.816800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:13.824938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 371/768] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:09:13.826815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.008318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58706e7d-3659-4554-ac0c-3749b8f65b34 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.019446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:14.040620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54facdae-f87d-46af-b6aa-8716e6bb5e60 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.064147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.065747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.066911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.067707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.090391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.093261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.109182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.110525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.110993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.111460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.112564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:14.114206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:14.114389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:14.116149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:14.118202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:14.119050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.119204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 398/769] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:14.124720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.125623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 372/770] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:14.129725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.262550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:14.313733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e4b79-eaf5-484a-ae2f-5eb8c31362ef None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.330739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531766-8e0c-42e8-a902-ae7d813f66b0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.365887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.366558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.366847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.367110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.384398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.386133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:14.410564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:14.412513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:14.422343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:14.422343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:14.422343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:14.422343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 399/771] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:14.422343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.428358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.429030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.429311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.429582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.430310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:14.430617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.433082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.456856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 373/772] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:14.456856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.466029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:14.637802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96970c8-782f-460a-83ee-aef53b17ffef None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.648796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690cae1-2cd8-41e6-9558-2a2dfa786790 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.697440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:14.713817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.715344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.716158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.717021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.718436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:14.719406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.720616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.722509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.723061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.723216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.724587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:14.725073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.726667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.735504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 400/773] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:14.738059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.746911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 374/774] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:14.746911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.873729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2722123-c795-482c-93a4-23ef967d995a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:14.922328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:14.923347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:14.923712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:14.924018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:14.924746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] RBAC: Adding query filter params (interface=public, service_id=0c2188c791314e85909c0827f44d0d7b, region_id=RegionOne) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:14.926875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:14.928081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:14.936399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:14.941203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 375/775] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/endpoints?service_id=0c2188c791314e85909c0827f44d0d7b&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:14.942293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:14.987043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b82447-3459-43cd-ae42-d486c5b88114 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:15.022299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:15.067422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:15.069147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.070022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.070889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.075032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=c21fbe153d904a19be3b27c499c4f88e, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:15.078445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:15.113181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918d60-a79e-4ae9-8702-81f2db9a6aa8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:15.133545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 401/776] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:09:14 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:09:15.142204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:15.160962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:15.160962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.160962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.160962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.167478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:15.169412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:15.184099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:15.186106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:15.188748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 376/777] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:15.197553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:15.333430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb285b-9a70-44e8-81ae-318dec3dbb34 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:15.367364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:15.439552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:15.440250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.440537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.440791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.442313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:15.442629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:15.444425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:15.463717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 377/778] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:15.470047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:15.627836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d20be-4b88-4668-8b86-3d3f6b5933da None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:15.730829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:15.731368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.731640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.731918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.732544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:15.734013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920348a-802a-4c21-b4f5-f1220fb9db55 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:15.745108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb85e8a-c307-4648-9f6d-6f70519c2e02 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:15.749452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 402/779] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:15 2022] GET /identity/v3/services => generated 772 bytes in 615 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:15.822583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:15.824288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.825281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.826060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.828022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=61a775a6854049d7b75a54aab8d448a4) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:15.829299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:15.832801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb29772-1ab7-4a90-8308-a2dcb809ba5e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:15.846128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 378/780] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:15 2022] GET /identity/v3/role_assignments?user.id=61a775a6854049d7b75a54aab8d448a4&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:15.887880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603b4f-2fc2-46de-8aea-de633d58e90a None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.888327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603b4f-2fc2-46de-8aea-de633d58e90a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.888715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71603b4f-2fc2-46de-8aea-de633d58e90a None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.891067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 403/781] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:15.911458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d1c92-d6dd-4ae8-8f67-b878acafbd1a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:15.912386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d1c92-d6dd-4ae8-8f67-b878acafbd1a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:15.913170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d1c92-d6dd-4ae8-8f67-b878acafbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:15.958808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ef2d1c92-d6dd-4ae8-8f67-b878acafbd1a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:15.961673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ef2d1c92-d6dd-4ae8-8f67-b878acafbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:16.044377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:16.147100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 379/782] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:16.689396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3f28-ed93-41e5-ac14-e2e4f13e6894 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:16.689883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3f28-ed93-41e5-ac14-e2e4f13e6894 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:16.690278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb3f28-ed93-41e5-ac14-e2e4f13e6894 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:16.693130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 404/783] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:16.701924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:16.702191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:16.702584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:16.733471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:16.734717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:16.751643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3f28-ed93-41e5-ac14-e2e4f13e6894 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:16.772740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:16.831807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 380/784] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:16.996238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb3f28-ed93-41e5-ac14-e2e4f13e6894 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:17.044587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:17.045300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:17.045571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:17.045897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:17.064496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:17.069386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:17.071253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:17.072879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 405/785] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:17.086238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:17.240280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:17.250466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f5b9-8b7b-4790-aab0-9a858b4c0b47 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:17.291358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:17.291995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:17.292274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:17.292541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:17.293262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:17.293566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:17.294977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:17.305706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 381/786] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:17.314035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:17.318181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:17.435203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d3a34-fffb-465c-9069-61ae5f778565 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:17.473783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:17.474435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:17.474731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:17.474989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] PATH_INFO: `/v3/services/network` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:17.475580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:17.477007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:17.487268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:17.489234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:17.490901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 382/787] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:17.500011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:17.521405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:17.561095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:17.643097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c35d9-43ce-4bab-81d6-a927eda22f3e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:17.744080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d78a09-0225-4862-b51c-8cbbbf850662 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:17.750396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:17.750396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:17.750856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:17.750856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:17.779301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:17.780759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:17.820451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:17.822305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:17.824073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:17.824073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:17.824073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:17.824073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 406/788] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 503 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:17.824509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:17.827469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:17.827685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:17.827685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:17.827685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:17.827685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] RBAC: Adding query filter params (name=network) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:17.827685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:17.829935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:17.838840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 383/789] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:17.850010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:18.070470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:18.100443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d0622-d1e6-4a5f-9f0e-26112f27209a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:18.145904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:18.146971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.147703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.148200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.150511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] RBAC: Adding query filter params (type=network) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:18.151193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:18.155290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13449a86-62c7-47ab-b90c-88a7e005905a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:18.167292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 384/790] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:18.169602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24bf-c652-4587-a054-7f9e5c3b671e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.170105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24bf-c652-4587-a054-7f9e5c3b671e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.170595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf24bf-c652-4587-a054-7f9e5c3b671e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.175962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 385/791] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:18.177125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf24bf-c652-4587-a054-7f9e5c3b671e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:18.218121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967176-dc3b-46e7-aa83-b2a81f4a2256 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:18.254516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:18.290558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:18.291677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.292172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.292670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.294007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:18.294554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:18.297258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80635d35-973b-43c1-99bb-2f8e83f94779 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:18.322744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 407/792] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:18.324671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf24bf-c652-4587-a054-7f9e5c3b671e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:18.325201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.325551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.326050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.358607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:18.361435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:18.368639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:18.369574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.370026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.370439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.371273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:18.372898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:18.418979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 386/793] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:18.420617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:18.437392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:18.644760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 408/794] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:18.681474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179aeecf-c4fe-4ce6-80f0-98e41554073f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:18.771117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:18.772903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:18.773745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:18.774524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:18.793891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:18.797244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-fb9f8f92-9ff9-44e2-9155-46516489bea2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:18.825466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:18.827234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:18.835565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:18.840586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 387/795] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:18.848884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:18.970714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d096-5d3b-4837-9a08-ca5f4b186fe9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:18.973603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:19.040096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:19.041776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.042830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.043601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.045463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:19.046420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:19.050073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:19.053211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a24c-eaf9-47b2-b476-fc6be57f0899 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.053547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a24c-eaf9-47b2-b476-fc6be57f0899 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.053818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0a24c-eaf9-47b2-b476-fc6be57f0899 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.055469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 388/796] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:19.061072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab631ad-0e87-496a-a3b5-ca24fe9efe2d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.061444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab631ad-0e87-496a-a3b5-ca24fe9efe2d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.061694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab631ad-0e87-496a-a3b5-ca24fe9efe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.084601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-aab631ad-0e87-496a-a3b5-ca24fe9efe2d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:19.086058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-aab631ad-0e87-496a-a3b5-ca24fe9efe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:19.090496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 409/797] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:09:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:19.097247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.166684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:19.192883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 389/798] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:19.192883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c2b2-8151-43a6-a86b-30b79f580132 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.192883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c2b2-8151-43a6-a86b-30b79f580132 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.193435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c2b2-8151-43a6-a86b-30b79f580132 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.195472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 390/799] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:19.196928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c2b2-8151-43a6-a86b-30b79f580132 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.263628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2399a-de6c-43b0-8a43-0bf8a0382bfc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:19.329066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:19.330089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.330569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.331054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.351328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:19.354118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:19.358020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c2b2-8151-43a6-a86b-30b79f580132 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-29d27811-cc53-41c1-8807-1972b1775f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:19.379880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:19.381804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:19.383583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:19.383583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:19.383583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:19.383583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 410/800] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:19.384018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.387673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.387673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.413107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:19.414501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:19.430537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:19.432079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.432547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.433069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.435337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:19.451498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:19.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:19.465246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 391/801] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:19.467111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.564865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 411/802] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:19.564865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.569121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:19.675736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a211f3-2704-4ffc-be3b-0da568cca748 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:19.744172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:19.745254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.745747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.746250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.747471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:19.748053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:19.751264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:19.753132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319fdf5-9b25-4437-a560-15414c4d4b91 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:19.775046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 392/803] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:19.777179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.828482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:19.830143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:19.830645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:19.831137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:19.832394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:19.832978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:19.835602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:19.859812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 412/804] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:19.859812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:19.872771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:19.937262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63bc02-9aef-465f-b7f4-893f101a6e75 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:19.962375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.001622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.002417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333a022-4369-4fa0-8eb5-136ea5caf73f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.002766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.003221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.003641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.023459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:20.029123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:20.031018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 393/805] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:20.033392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.049781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.050445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.050725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.050997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.059745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.061304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:20.074387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:20.076229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 413/806] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:20.078013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.164333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b2420-759a-467a-9ea2-cade8da4db73 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.200557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.207192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.208288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.208739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.209270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.210319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.213039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:20.230669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:20.231991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:09:20.233132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:20.234063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 394/807] 10.222.0.69 () {56 vars in 1129 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:20.234665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.256840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d87e6-c1ac-41c0-b2f5-53370dea2a0d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.294298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.294944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.295225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.295492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.299607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.309342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.310841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:20.328406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:20.330593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:20.332616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:20.332616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:20.332616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:20.336174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 414/808] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:20.337104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.412610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62754-d1e7-46c0-bb57-8a1f5f15c3be None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.464727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.465485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.465861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.466220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.467034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:20.467425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.469376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.486553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 395/809] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:20.486553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.486945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361d675-2f20-422d-84c9-7e29af4cfb76 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.504938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.524243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.524921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.525209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.525477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.526211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:20.526475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.527987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.547582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 415/810] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:20.549363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.635348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.640038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f30d42-fb5e-4cc5-9a12-8046db02c7fd None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.694877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.695888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.696370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.696906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.698096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:20.698679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.701515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.717962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 396/811] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:20.717962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.727154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc8f82-f2d5-446e-ad7b-4684975ea1f1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.776109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.776922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.777293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.777658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.778483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:20.778890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:20.780390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:20.793940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 416/812] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:20.795005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:20.855060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:20.897941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7ac52-b2f7-4b1b-8d7d-f0b4e7508559 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:20.950434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:20.951027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:20.951300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:20.951575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:20.955706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6933f-5c74-4229-a3ad-cae9d117b366 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.027108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:21.028252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:21.028716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:21.029222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/783f430a59254acfbb4a7af3bb69b472/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:21.033436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=783f430a59254acfbb4a7af3bb69b472, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.036369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.061255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 417/813] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:09:20 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/783f430a59254acfbb4a7af3bb69b472/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:09:21.062665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.088462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.090053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:21.107959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:21.118788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:21.120792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:21.120792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:21.120792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:21.120792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 397/814] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:21.120792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.149095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:21.292405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:21.299401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44502702-ff79-4c0d-838a-277b3e874d82 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.322702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3460b-928a-4394-a1f7-a24a8540401f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.364055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:21.365000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:21.365543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:21.365993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:21.367083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:21.367586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.369800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.387506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 418/815] 10.222.0.69 () {56 vars in 1124 bytes} [Tue Aug 23 22:09:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:21.387506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.398671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:21.399814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:21.400332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:21.400774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:21.415316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.417579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:21.439838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:21.442067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:09:21.444325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:21.448477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 398/816] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:09:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:21.449669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.568747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:21.589666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9c72-bdae-4628-a323-02d12cca9b4a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.611912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852777a1-5dfd-40e3-9259-395e9409be8f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.658087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:21.659144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:21.659638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:21.660121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:21.661349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:21.662077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.664870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.677967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:21.679147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:21.679723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:21.680285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:21.681623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:21.684396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:21.688588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 419/817] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:21.690166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.732863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 399/818] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:21.732863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:21.756534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:21.923154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aedff1-2319-4e74-9dbb-3bb03b261447 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:21.964448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f8bea-bae3-4355-8a71-bd799d8c6e0e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:22.008079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.009080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.009551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.010243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.012065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:22.012581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.015403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.019065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:22.050073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.050073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.050538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.050935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.059714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 420/819] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:09:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:22.066853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.069853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.070211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:22.097661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:22.099459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:22.101396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:22.106180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 400/820] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:22.116274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:22.231632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:22.274647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99fdae-c8ba-404f-ab7c-83ae855e1199 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:22.330750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294537e-763e-4fe0-8820-c85e6ae7274d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:22.347698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.348800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.349323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.349810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.423777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.424962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.425443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.425900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.427228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:22.427765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.430740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.468440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 401/821] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:22.478680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:22.501889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.504734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.572015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:22.670090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:22.703493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24cb2-c9ce-4b0c-9da6-ecea8c86593a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:22.704890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 421/822] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:09:22.706702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:22.789449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.790911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.791846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.792527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.815263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.818757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:22.866019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:22.868096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:22.869882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:22.869882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:22.869882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:22.873361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 402/823] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:22.883710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:22.892735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1becf-dc23-4ef0-87de-0df7d99bbcf6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:22.939255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:22.940233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:22.940726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:22.941219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:22.955127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:22.957275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:22.992571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:22.993718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:22.994666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:22.994666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:22.994666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:22.997058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 422/824] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:23.005710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.057574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:23.068357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3c5f2-7a18-4b1b-addd-623124047e94 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.083032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:23.155465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.156131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.156409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.157583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.158396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:23.158711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.160397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.181051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 403/825] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:23.183354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.203950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a01c3-f425-4779-9a6c-baebae471be7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.255957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.256621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.256938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.257215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.257879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:23.258189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.259608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.277029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 423/826] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:23.283334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.401958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0daed0-6af4-4619-95a8-3de0429001d4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.426311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:23.445140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ba14d-0a76-4cec-8199-8f811b7aae79 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.451293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.452071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.452242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.452488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.461989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.463533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-73fa1ae8-2c71-4dae-8bfb-941ad9e449e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:23.482061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:23.483920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 404/827] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf54c-54f6-4d4e-9c3e-4b1f0213cf81 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.487821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf54c-54f6-4d4e-9c3e-4b1f0213cf81 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.490175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bf54c-54f6-4d4e-9c3e-4b1f0213cf81 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.491851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 405/828] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:23.493471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.493756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.494032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.514928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:23.516726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:23.528438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.529541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.530010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.530870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.532435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:23.546484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.549281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:23.572875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:23.573873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:23.574848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:23.577339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 424/829] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:23.577339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.658696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 406/830] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:23.661071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.768205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda4366-fbf0-4770-9182-5fb0e53d2525 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.839682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.840719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.841262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.841727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.843359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:23.843907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.846947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.861339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28845ec-06e3-4043-8702-dffa35a1a5a1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:23.872489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 425/831] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:23.879345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.899758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:23.933367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:23.934449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:23.934979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:23.935500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:23.936768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:23.937630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:23.940739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:23.969080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 407/832] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:23.972509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:23.990590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:24.052270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5f74b-f770-4c30-b571-5f473a79c0be None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:24.103287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:24.105250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:24.106848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:24.107372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/61a775a6854049d7b75a54aab8d448a4/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:24.133726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=61a775a6854049d7b75a54aab8d448a4, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:24.136281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:24.165163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 426/833] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:09:23 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/61a775a6854049d7b75a54aab8d448a4/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:09:24.173838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f10a4-a9eb-4edd-9274-9695dc621edc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:24.181313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:24.245239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:24.246219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:24.246667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:24.247104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:24.248663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:24.249201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:24.252155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:24.263780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 408/834] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:23 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:24.305188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:24.385979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a691-2683-46d6-aabc-f40f3684c5ac None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:24.455579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:24.456689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:24.457333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:24.457832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:24.473458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:24.479268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:24.480456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:09:24.481502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:24.483346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 427/835] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:24.493687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:24.652337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:24.718871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5b409-162f-4b93-840b-16be51317533 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:24.769251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:24.769890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:24.770193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:24.770475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:24.771191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:24.771500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:24.772969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:24.783696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 409/836] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:24.790782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:24.916306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b042ac1-9c4d-421c-ad3f-6a41b5ed0376 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:24.945399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:24.960600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:24.961330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:24.961652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:24.962028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:24.975399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:24.976901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:24.994593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:24.995634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:24.997000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:24.997000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:24.997000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:24.997000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 428/837] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:25.002996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:25.130783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b829888-b500-4c7e-8fbc-92e365a70913 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:25.194722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:25.206862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:25.207934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.208430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.208951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.210188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:25.210748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:25.213463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33ca76-ce80-4621-af2f-aba04e13e924 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:25.239043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 410/838] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:25.244486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:25.265489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bdb2c-2ce7-4705-993c-52de1302236d None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.266035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bdb2c-2ce7-4705-993c-52de1302236d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.267037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bdb2c-2ce7-4705-993c-52de1302236d None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.270018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 411/839] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:25.279150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.279655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.280156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.317425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:25.319833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:25.369867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4359f30-25b3-4876-9c10-e4329d504ca1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:25.414433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:25.415082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.418601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.418601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.429495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:25.429495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:25.441344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:25.442393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 22:09:25.443423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:25.447848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 429/840] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:09:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:25.448883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:25.494974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:25.498233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 412/841] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:25.586567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49a9d4-d8c4-43a3-8c47-be6648e42fcd None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:25.629503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:25.630208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.630496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.630828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.631628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:25.631939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:25.633569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:25.660486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 430/842] 10.222.0.69 () {56 vars in 1135 bytes} [Tue Aug 23 22:09:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:25.666684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:25.811185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c8af8-ff9a-4bfc-a8bb-5c700e85c879 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:25.861108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:25.883303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:25.884190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:25.884610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:25.884941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:25.936499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.009602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.012340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.121703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:26.135553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01ef26-b352-463f-b888-093d8bc19d22 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:26.180193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:26.181292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:26.181802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:26.182291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:26.183116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.184752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:26.195547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:26.196681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:26.197568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:26.206321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 431/843] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:26.207648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.229102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 413/844] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:09:26.237431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.279348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:26.380990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d886f-f8d2-4806-9be9-7d4195d6a979 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:26.437788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942ea1-dad2-4819-a873-196d0c90c04e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:26.466718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:26.467889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:26.468684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:26.469642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:26.471200 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:26.472070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.474555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.484569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 432/845] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:26.492981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.521026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:26.521936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:26.522097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:26.522591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:26.523197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:26.551085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.555222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:26.574672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:26.575787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:26.576697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:26.576697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:26.576697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:26.579942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 414/846] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:26.589008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.674765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42b68f4-a623-4043-bd61-a9bb76ce4644 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:26.707596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:26.728358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:26.729144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:26.729514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:26.729856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:26.730682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:26.731054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.732719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.742651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 433/847] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:26.744109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f66ec-06a8-4d1c-9977-a7f1903a33d9 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:26.805315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:26.806404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:26.806915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:26.807396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:26.808638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:26.809231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:26.811935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419523e-1016-4bae-a2ae-ff7f2ebdc668 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:26.837749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 415/848] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:26.843712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:26.972608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:27.003131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ee4b7-a41e-4232-9edd-cb3cd1a7dc04 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:27.015569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3f0f-3ea8-4593-bf66-d91aaa8fbf7a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.015902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3f0f-3ea8-4593-bf66-d91aaa8fbf7a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.016716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc3f0f-3ea8-4593-bf66-d91aaa8fbf7a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.018255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 416/849] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:27.027313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f654-84e2-4630-b157-602417104bcb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.027795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f654-84e2-4630-b157-602417104bcb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.028265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6f654-84e2-4630-b157-602417104bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.056866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:27.057602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.057887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.058169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.059005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5fd6f654-84e2-4630-b157-602417104bcb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:27.061041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5fd6f654-84e2-4630-b157-602417104bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:27.069249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:27.072230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-73cb1ed6-2644-4c65-9a63-1110ce153a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:27.096023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:27.098064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:27.100006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:27.103619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 434/850] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:27.106178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858338-c050-47a6-a975-5a1f1ce0a486 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.106917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858338-c050-47a6-a975-5a1f1ce0a486 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.107606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af858338-c050-47a6-a975-5a1f1ce0a486 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.111326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 435/851] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:27.113308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858338-c050-47a6-a975-5a1f1ce0a486 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:27.188856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 417/852] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:27.188856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.188856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.188856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.216709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:27.219773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:27.292297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af858338-c050-47a6-a975-5a1f1ce0a486 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:27.326438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:27.345852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 418/853] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:27.352143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:27.353283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.353755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.354231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.355489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:27.356003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:27.358787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:27.384530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 436/854] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:27.394504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:27.544426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478db6c9-98a6-4b2d-9933-c919b9fd7b38 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:27.568182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:27.573251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:27.590102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:27.591189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.591826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.592108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.592922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=783f430a59254acfbb4a7af3bb69b472) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:27.593239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:27.595624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:27.603089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 419/855] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:27 2022] GET /identity/v3/role_assignments?user.id=783f430a59254acfbb4a7af3bb69b472&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:27.720890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21f82f-077a-4727-b383-9afb7245356c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:27.772005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:27.772914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:27.773417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:27.773909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:27.794809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:27.804745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:27.806056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:27.806928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:27.807745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 437/856] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:09:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:27.817496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:27.827681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:27.912747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:27.933897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:27.978501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d216fdd-e3a9-48f9-b65a-7203aaa6107e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:27.986480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8712f-fee3-4a44-8a34-db83be000b85 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.030763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.031499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.032344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.032616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.033347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.035029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.036361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.037537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.038182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.038711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.039653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:28.040172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.042200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:28.045818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:28.046821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:28.048482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 438/857] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 23 22:09:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:28.057107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.065081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 420/858] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:09:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:28.068395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.168740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8ac9e-bd27-465a-adfa-2d127b388e1a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.193800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621708e9-f375-445a-9651-66c1971ebc40 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.198384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:28.208418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.209078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.209353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.209624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.210260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:28.210559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.211983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.217476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 439/859] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:28.229747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:28.231562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.246169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.247197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.247655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.248100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.262655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.264424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:28.283774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:28.285136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:28.286486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:28.286486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:28.286486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:28.292959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 421/860] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:28.295271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.402399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6934b-f971-4a83-a33a-3b49d273e51c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.461661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.462333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.462619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.463053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.464255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:28.465001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.467902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.478728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 440/861] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:28.479119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b680d4-2b28-47cb-a1e7-8fedf5d50a00 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.528992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.529674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.529957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.530231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.530917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:28.531226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.533771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.554583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 422/862] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:28.560939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.672779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:28.729429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07ba31-864e-4321-8e81-1eac009cb2e2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.768355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.769115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.769402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.769671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.778555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.780060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:28.793741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:28.794828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:28.796484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 441/863] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:28.801578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:28.847379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:28.932906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546119f-eda2-47dc-b0fe-d95dd5068e49 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:28.975997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:28.977075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:28.977564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:28.978042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:28.979017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:28.979575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:28.981990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef8576-ccfa-4c79-9cfa-9bea81fe8a0d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:29.008849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 423/864] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:29.015404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:29.022198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e965d-5f29-49bd-bd3e-f1936ff3f6e9 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:29.022529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e965d-5f29-49bd-bd3e-f1936ff3f6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:29.022817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e965d-5f29-49bd-bd3e-f1936ff3f6e9 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:29.024729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 424/865] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:29.030518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:29.030818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:29.031072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:29.051997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:29.053837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:29.169738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 425/866] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:29.201847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a562297-10c8-4519-8bb4-b4584a2b117a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:29.224511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:29.250416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:29.251766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:29.252234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:29.252676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:29.340881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:29.342457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:29.457697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 442/867] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:09:29.466017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:29.503203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:29.556650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:29.605209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:29.667970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b544acb-1c16-4b70-938d-f7d4452ab911 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:29.738265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:29.739493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:29.740101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:29.740711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:29.747012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d53b1d-871a-4bbb-b259-cae0ffe22bbe None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:29.758578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:29.761531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:29.792437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:29.793601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:29.794675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:29.794675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:29.794675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:29.804636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 426/868] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:29.806554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:29.811986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:29.813612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:29.814157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:29.814601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:29.815962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:29.818419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9315e-1429-4090-9e05-befd9844ca17 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:29.852934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 443/869] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:29 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:29.957526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:30.021002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493966f-e949-44a0-a568-2c34a1851466 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:30.104029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:30.105129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.105598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.106074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.107663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:30.108213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:30.108955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b355-b31c-49bc-a522-ca61645ca76a None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.109439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b355-b31c-49bc-a522-ca61645ca76a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.110446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0b355-b31c-49bc-a522-ca61645ca76a None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.111393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:30.117286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 444/870] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:30.120391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.120897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.121366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.136303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 427/871] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:30.148569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:30.156391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:30.158504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:30.315097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 445/872] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:30.363223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1cd4c-7df1-47e1-93a1-9ee8139a7c29 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:30.431668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:30.432716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.433274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.434130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.438268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:30.448884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:30.452028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-23e02bd0-0606-4235-a72e-2032dc7f7a38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:30.475717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:30.476704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:30.477661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:30.478636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 428/873] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:30.486918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:30.504624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:30.696688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab8aa-3a35-4ece-8c2e-e85f76d56252 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.697373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab8aa-3a35-4ece-8c2e-e85f76d56252 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.697561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ab8aa-3a35-4ece-8c2e-e85f76d56252 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.700100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 429/874] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:30.706294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.706666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.706837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.708627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae5fe-bf7d-4ed6-99df-5c7338eb6717 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:30.734069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:30.737088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:30.776592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:30.777659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:30.778134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:30.778587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:30.779932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:30.781282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:30.784058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:30.808792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 446/875] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:30.810194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:30.866969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 430/876] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:30 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:30.868475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:30.926950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:30.999082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9739e8-5528-4898-8556-91b69a8eb16a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:31.051648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cae9c-2ca5-415b-80f2-a2fa7b0c0498 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:31.081603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:31.084053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:31.085075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:31.085997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:31.087423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:31.090108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:31.095509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:31.116591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:31.118663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:31.120382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:31.126364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 447/877] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:31.129805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:31.139949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:31.141610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:31.142375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:31.143150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:31.144933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=61a775a6854049d7b75a54aab8d448a4) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:31.145815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:31.150008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:31.166881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 431/878] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:30 2022] GET /identity/v3/role_assignments?user.id=61a775a6854049d7b75a54aab8d448a4&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:31.333631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e6e4-efcb-4324-b447-c53ee7a6cb9d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:31.371515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:31.399758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:31.419834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:31.419834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:31.419834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:31.419834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:31.420532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:31.420532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:31.424296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:31.436134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 448/879] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:31.446775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:31.585531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edbb2d-1de0-4d7a-93c7-499ce2b5b4af None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:31.653267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:31.654763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:31.655500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:31.655659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b6de2-448d-42d9-bde4-16c8e40f87a5 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:31.657597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:31.659283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:31.662197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d191b-dbb0-4f1d-a5e9-944b55c0ba54 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:31.696904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 432/880] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:31 2022] POST /identity/v3/services => generated 269 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:31.738317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:31.739257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:31.739740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:31.740227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:31.741607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:31.742277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:31.745027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a36e03-01b6-4223-a3f3-22f300b1d71e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:31.761184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 449/881] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:32.312711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963adb-1e5e-4790-a869-9d7fc9eaca2b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:32.313814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963adb-1e5e-4790-a869-9d7fc9eaca2b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:32.314287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963adb-1e5e-4790-a869-9d7fc9eaca2b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:32.317111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 433/882] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:32.326430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:32.326938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:32.327422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:32.360326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:32.362629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:32.461110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:32.495893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 450/883] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:33.004139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963adb-1e5e-4790-a869-9d7fc9eaca2b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:33.088542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:33.207628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963adb-1e5e-4790-a869-9d7fc9eaca2b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:33.278418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:33.279514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.280011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.280504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.282201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:33.284863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:33.303523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:33.305977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:33.307988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 434/884] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:33.318693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:33.526862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843410e-6d2f-4759-bfdb-5aedf3de5ebd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:33.597216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:33.598197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.598640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.599052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.600191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:33.600713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:33.603387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915aa2e-87e4-49c5-9df4-4066dc2ac62b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:33.614592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 451/885] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:33.620081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:33.724116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdb48-685c-436f-b6f0-5affa2c9e6fb None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.724116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdb48-685c-436f-b6f0-5affa2c9e6fb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.724116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abdb48-685c-436f-b6f0-5affa2c9e6fb None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.725006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 452/886] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:33.730908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.731546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.732042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.739362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860857f-d490-428d-9667-57aaabd9e0a6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:33.747597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:33.756145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:33.757896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:33.780595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:33.781276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.781622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.781971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.783098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:33.783398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:33.785369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:33.796925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 435/887] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:33.799745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:33.837454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:33.861697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 453/888] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:33.926477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614705da-6cae-4e7c-98d6-24261f1da812 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:33.968841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:33.969946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:33.970514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:33.970991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:33.971916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] RBAC: Adding query filter params (interface=public, service_id=4a9c408441be4e8f9840b90d876e242c, region_id=RegionOne) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:33.972438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:33.974079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:33.980664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 436/889] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:33 2022] GET /identity/v3/endpoints?service_id=4a9c408441be4e8f9840b90d876e242c&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:33.987311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:34.102936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa4664-e755-41f3-a367-407e91c1ac19 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:34.141882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:34.151021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:34.151655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.151937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.152212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.153163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:34.154515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:34.162798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 454/890] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:33 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:09:34.192757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:34.318238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed4f44-ffbc-4a43-8538-9d911b672e42 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:34.390405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:34.391550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.392362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.395997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.414605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:34.426727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:34.427736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:34.428595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:34.431072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 437/891] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:09:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:34.441639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:34.496802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:34.563716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c38bc-2b76-4f69-bb8c-729ed11907c1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:34.606760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:34.607397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.607670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.607942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.608644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:34.608988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:34.610486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a44e2a-64a2-47ac-9fcb-4dc10bdedac2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:34.620935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 455/892] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:09:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:34.630498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:34.672833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438534-6892-4237-978c-de56b4ecd99b None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.673064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438534-6892-4237-978c-de56b4ecd99b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.673222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438534-6892-4237-978c-de56b4ecd99b None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.674879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 456/893] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:34.680931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.681312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.681539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.710154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:34.712759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:34.774443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:34.792528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a14f1-5e3d-46a3-8a55-02f4cc020279 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:34.843395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 457/894] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:34.848787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:34.849485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:34.849763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:34.850032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:34.862913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:34.864390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-892ab09c-5c69-44ef-b636-440b81aeb807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:34.882354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:34.884047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:34.885794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:34.885794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:34.885794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:34.885794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 438/895] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:34.897455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:34.969826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:35.021679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ab501-326b-4d2f-8165-7c613e7b186f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.022132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ab501-326b-4d2f-8165-7c613e7b186f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.022563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ab501-326b-4d2f-8165-7c613e7b186f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.032557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 439/896] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:35.035385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.035988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.036722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.065573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:35.067022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:35.126160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72c23b-b5f4-4b70-b51b-b260ad049e11 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:35.158830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 440/897] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:35.158830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.190040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:35.190757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.191091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.191420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.192199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:35.192561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:35.194058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:35.213893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 458/898] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:35.215078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.330415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:35.343104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:35.354717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdefd5-3fc7-4526-b24d-cd759e851667 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:35.388428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab85fb-61f7-4aa0-a812-5e40419ccf43 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:35.432620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:35.434719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.436080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.437193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.441570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:35.442480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.442818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.443168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.443914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:35.445715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:35.457397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:35.461505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:35.470165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 441/899] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:35 2022] POST /identity/v3/services => generated 241 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:35.487945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:35.489850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:35.491822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:35.496566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 459/900] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:35.508065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.664205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.722443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468be86a-167a-4fba-b5d4-660412f5a882 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:35.780801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:35.789557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:35.790566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.791023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.791486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.792755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:35.793321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:35.796124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:35.827909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6543492-e445-46dc-ac7b-eb8fb699f3e2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:35.832514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 442/901] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:35.841488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.881713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:35.882803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:35.883278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:35.883708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:35.884737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:35.887363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:35.905017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:35.907100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:35.908667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 460/902] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 23 22:09:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:35.917815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:35.972093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:36.001399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa8a5-6c6d-4889-a179-55f93cff4eaf None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.074779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.076135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.076738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.077365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.082689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7770b-2ab9-4cea-9efb-60c262a5ad7a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.133417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.134843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.135872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.136730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.137820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:36.138343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.142458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.155318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 461/903] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:36.161789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:36.170527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:36.183547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.185054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.303797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 443/904] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:09:36.315786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:36.322053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:36.352578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31c53f-fce9-46a7-92fe-a8d3619996f6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.397605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.400837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.400837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.400837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.400837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:36.400837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.403141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.417299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 462/905] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:36.425923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:36.507442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:36.535727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df4ca6-bda8-42a4-835d-9c31722b94fc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.591777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c992c9d-e6cb-4cb1-9ed4-f8c14e289f01 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.633235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.634644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.635373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.636062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.636247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.636909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.637194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.637470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.638439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] RBAC: Adding query filter params (interface=public, service_id=d1fb8da0914b4c6aa1b7315b01c56c78, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:36.638755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.640134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.653591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 463/906] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:36 2022] GET /identity/v3/endpoints?service_id=d1fb8da0914b4c6aa1b7315b01c56c78&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:36.654922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:36.666877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.671089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.676079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:36.720069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:36.721891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:36.723317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:36.723317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:36.723317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:36.733217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 444/907] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:36.736359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:36.833002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960760-41f6-4fe4-9a42-c66c989034e8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.905538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.907699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.908466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:36.909289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:36.910719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:36.913747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:36.925595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 464/908] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:36 2022] GET /identity/v3/services => generated 1497 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:09:36.932603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498ad38-2efa-4770-a260-84bea76d467d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:36.997357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:36.998867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:36.999655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.000942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.002355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:37.003181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:37.005890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a7f67-4f9d-4976-94be-493aea4ab1f1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:37.029995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 445/909] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:37.039988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:37.139171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a09e2-e8e6-4130-9da6-634a0003b37b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:37.139613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a09e2-e8e6-4130-9da6-634a0003b37b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.140072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a09e2-e8e6-4130-9da6-634a0003b37b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.143299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 446/910] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:37.154955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:37.155403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.155834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.167248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:37.184488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:37.191239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:37.193203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:37.225160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b50dcc-a782-4ead-8fcb-5c6b9d2c83bf None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:37.293714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:37.294791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:37.295263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.295735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.308947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:37.312175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:37.332694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 447/911] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:37.334634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:37.336345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:37.337607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 465/912] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:37.344587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:37.460887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ff25-4226-489f-ad69-b780f3447fbf None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:37.497288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:37.501699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:37.502217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:37.502719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.503297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.504091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:37.504480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:37.506112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:37.520128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 448/913] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:37.527246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:37.646521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59286272-46a3-4cf3-9276-c331dd135338 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:37.685677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:37.686295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:37.686570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:37.686839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:37.687618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] RBAC: Adding query filter params (role.id=913f363b1b2d40d887716c604d7c9e52, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=61a775a6854049d7b75a54aab8d448a4) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:37.688649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:37.690355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:37.697035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:37.701309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 466/914] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:37 2022] GET /identity/v3/role_assignments?user.id=61a775a6854049d7b75a54aab8d448a4&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=913f363b1b2d40d887716c604d7c9e52 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:37.793583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:37.969530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ad05d-66ea-48ce-b852-3a999934c1ac None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:38.044734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:38.045772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.046420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.048582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.048721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:38.051519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-1f416130-c8f9-4db1-8802-1fc15b44cc20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:38.069913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:38.071380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:09:38.072210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:38.073059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 449/915] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:38.082376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:38.230870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab62ff-72cc-4165-a8fd-42d4729e1990 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.231877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab62ff-72cc-4165-a8fd-42d4729e1990 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.232361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab62ff-72cc-4165-a8fd-42d4729e1990 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.241748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 450/916] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:38.243477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.244003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.244470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.268249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:38.269980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:38.295917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4375fe-0c6b-4bcf-83e8-d5ef54fb72e6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:38.376756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:38.378517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.379278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.380009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.381490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:38.382354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:38.384653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:38.387529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:38.402399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 467/917] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:38.412138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:38.428455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 451/918] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:38.569734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:38.661856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e0b85-ea0b-4d57-8b0e-abcf46bb34c7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:38.738659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:38.740262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.741116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.742134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.743701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:38.744589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:38.747685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:38.759535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 468/919] 10.222.0.69 () {56 vars in 1114 bytes} [Tue Aug 23 22:09:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:38.769878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:38.854109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:38.894343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a3ab-d531-4839-a9ae-f19bbed57324 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:38.954517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:38.956894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:38.957902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:38.958860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:38.961410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:38.966028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:39.017589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eecc788-234a-4266-b8a7-9b4a7bb61d68 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:39.020331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 452/920] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:39.079025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:39.110653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:39.112400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.113331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.114224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.115728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:39.118759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:39.138318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:39.140266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:39.142536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:39.150360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 469/921] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:39.160592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:39.259180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:39.366767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d28223-d4d0-4f68-bd65-042547b56e1e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:39.417448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:39.418210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.418498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.418845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.419688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:39.420081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:39.421560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc24f7-baba-4de3-acbd-0955e2847d9f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:39.433639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 453/922] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:39.445557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:39.650166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157ac7-88f1-467c-9cd0-bda790db320a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:39.718568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:39.722645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.723310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.723990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.725398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:39.726166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:39.729118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:39.739205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 470/923] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:39.739892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d926-44b6-4473-a568-593df660ca1e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.740669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d926-44b6-4473-a568-593df660ca1e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.741470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d926-44b6-4473-a568-593df660ca1e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.744741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 454/924] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:39.745138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:39.752796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.752796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.752796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.775444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:39.776610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:39.833843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:39.894622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 455/925] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:39.902132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a480bb-5da0-456f-af13-09eb88293465 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:39.941073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:39.942150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:39.942634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:39.943157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:39.944483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] RBAC: Adding query filter params (interface=public, service_id=c799b8451e58480383c0889ff248b2dc, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:39.945088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:39.947047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:39.955391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 471/926] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:39 2022] GET /identity/v3/endpoints?service_id=c799b8451e58480383c0889ff248b2dc&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:39.964852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.035912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:40.139146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10d0a8-fb7e-4c90-b52e-d8594baf331e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:40.179598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:40.180156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.180440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.180688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.181335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:40.182716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62cc582-afef-407c-aa32-4180b8b0ef11 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:40.190017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 456/927] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:39 2022] GET /identity/v3/services => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:09:40.245901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.380556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f2102-a699-477a-9e80-f39d073aa396 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:40.389994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532deaf6-99c0-4941-add6-c883fdae7074 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.390531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532deaf6-99c0-4941-add6-c883fdae7074 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.390531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532deaf6-99c0-4941-add6-c883fdae7074 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.392467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 457/928] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:40.400148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.400429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.400707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.403421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:40.423758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:40.425475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:40.445172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:40.446189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.446675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.447148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.448056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:40.449942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:40.461592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:40.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:09:40.463501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:40.465892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 472/929] 10.222.0.69 () {56 vars in 1132 bytes} [Tue Aug 23 22:09:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:40.477070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.529317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 458/930] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:40.623891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f97301-1908-4722-b65a-6a9188e73f19 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:40.663243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:40.664117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.664543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.665024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.665866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:40.666315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:40.667833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:40.673966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 473/931] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:40.679965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.725062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:40.848903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c7c63-72df-4ddf-993a-26551a4c5afa None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:40.899361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.912379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:40.913284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:40.913728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:40.914147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:40.914964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:40.915420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:40.917010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:40.924111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 459/932] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:40.933093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:40.958050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.027527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68866c15-5043-4561-95db-51c8093cd65d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.040690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.051839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664b2c0-f347-467e-b82e-315b01716ae3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.069873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.070361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.070857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.071298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.084512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:41.089875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:41.090850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:41.091704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:41.097643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 474/933] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:09:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:41.098514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.099372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.099839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.100286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:41.100464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.101466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:41.103068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:41.127464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 460/934] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:41.244765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd07eb-4897-4c3b-ad7a-3201116f141f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.247015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.297712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.298885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.299400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.299905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.300828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:41.301348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:41.302971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718840d-b6c5-4ecb-82e4-1e459bd91807 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:41.314539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 475/935] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:09:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:41.324740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:41.441953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a52-0dfc-4140-8500-9a9760dd7c30 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.442949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a52-0dfc-4140-8500-9a9760dd7c30 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.443351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5a52-0dfc-4140-8500-9a9760dd7c30 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.445180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 476/936] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:41.450938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.451344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.451842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.459398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cff5-7946-4bbe-848b-e7db801b422e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.473346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:41.474708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:41.498928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.499835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.500321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.500743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.514344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:41.515391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:41.533276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:41.534467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:41.535396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:41.535396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:41.535396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:41.535814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 461/937] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:41.546149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:41.551666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.601574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 477/938] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:41.688119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201c303-37ed-4ec3-acce-d2d5bfeb75af None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.746019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.746997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.747492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.747971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.748885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:41.749387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:41.751570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:41.767617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 462/939] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:41.777174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:41.878793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:41.893727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.905100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd261db-9ebb-4152-8091-2259fa369342 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:41.970829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:41.972699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:41.972699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:41.973240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:41.992667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:41.995757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:41.998249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:42.031078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:42.032584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:42.033955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:42.037770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 478/940] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:42.039651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:42.057032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e61fc6-81d9-4e3e-9133-9998ca50fab5 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.100154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.101233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.101725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.102202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.103074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.104746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.107787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING keystone.server.flask.common [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 22:09:42.128714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.sql.core [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:09:42.128714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:09:42.128714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [parameters: {'id': '96c00878f5114650a3b511cc632f449d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:09:42.128714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81714) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96c00878f5114650a3b511cc632f449d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96c00878f5114650a3b511cc632f449d. Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:09:42.148667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result.read() Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 22:09:42.149725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application yield resource Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise self.value Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application session.commit() Aug 23 22:09:42.150927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:09:42.151841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:09:42.152888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result.read() Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:09:42.153694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [parameters: {'id': '96c00878f5114650a3b511cc632f449d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.154603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:42.155413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96c00878f5114650a3b511cc632f449d. Aug 23 22:09:42.157042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.164495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 463/941] 10.222.0.69 () {60 vars in 1140 bytes} [Tue Aug 23 22:09:41 2022] POST /identity/v3/projects => generated 262 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:42.165987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:42.214247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aa935-83ac-42b3-8ccd-1b501b58aa9a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.258448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.259777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.259777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.259997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.260708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:42.261228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.262810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.295433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b25bd7-43a5-442e-8e66-4973d779ab1f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.301072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 479/942] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:42.304170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:42.324009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:42.324948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:42.347540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.348801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.349386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.349956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.363249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.366394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3c911453-1324-4e71-aa46-062a6f467c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:42.389975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:42.391313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:42.392631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 464/943] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:42.399045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d723de-4a62-4858-8bdf-8ae66c5084c9 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.399278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d723de-4a62-4858-8bdf-8ae66c5084c9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.399507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d723de-4a62-4858-8bdf-8ae66c5084c9 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.403871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 465/944] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:42.404476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d723de-4a62-4858-8bdf-8ae66c5084c9 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:42.498960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17a32-5d3d-46d7-bd5f-2f8b14789a73 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.561900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.562745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.562933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.563248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.571770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d723de-4a62-4858-8bdf-8ae66c5084c9 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.575065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.576577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-e7294fbb-0c1f-4460-858c-60f3b511e133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:42.595078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:42.604650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 480/945] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.606694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.622203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:42.623475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:42.649551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.650787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.652368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.652654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.653386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:42.653699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.655965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.688850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 466/946] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:42.688850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:42.724678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:42.740357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 481/947] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:42.746033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:42.823148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b45d1-ef13-4ca7-80d0-e346b00d7c99 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:42.867760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:42.868430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:42.868711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:42.869019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:42.869685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:42.870067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:42.871556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:42.886557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 467/948] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:42.893991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.027885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42186c6-28d2-49b0-a7e8-6e120a72364a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.074915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.075568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.075846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.076145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.085108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.086587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:43.099395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:43.100395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:43.101325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 482/949] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:43.108956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.227777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.228754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b33c4-610c-430a-b847-70773f1a6946 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.231552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:43.280424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.280995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.281334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.282032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.283155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:43.283155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.284626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.287332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:43.300693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 468/950] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:43.306754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.365615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e3fad-b512-47a9-b1b7-ecda93a6e688 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.416864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.417890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.418331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.418642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.419185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.420566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-8595a29e-394d-45de-864a-646027b30d36 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:43.430966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:43.432535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:43.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 483/951] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:43.434670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde237ad-f83b-476e-8e05-f71c47b97770 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.434670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde237ad-f83b-476e-8e05-f71c47b97770 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.434670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde237ad-f83b-476e-8e05-f71c47b97770 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.436129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 484/952] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:43.441811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde237ad-f83b-476e-8e05-f71c47b97770 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.449093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e22f2-5056-4011-acdd-80e4bab2792d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.500590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.502251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.502998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.503489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/61a775a6854049d7b75a54aab8d448a4/roles/913f363b1b2d40d887716c604d7c9e52` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.507484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=61a775a6854049d7b75a54aab8d448a4, role_id=913f363b1b2d40d887716c604d7c9e52)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.510227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28828ec0-9ed8-4aa8-a7fd-3b1d8379a9aa None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.545028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 469/953] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:09:43 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/61a775a6854049d7b75a54aab8d448a4/roles/913f363b1b2d40d887716c604d7c9e52 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:09:43.547937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.548451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.548785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.581488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:43.583188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:43.583457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde237ad-f83b-476e-8e05-f71c47b97770 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.604157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:43.605331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:43.636064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.636857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.637222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.637591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.638377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:43.639390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.641133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.652877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 485/954] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:43.654163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.709391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 470/955] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:43.776739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2667b7-7319-4787-97ab-ffe5bc4dc846 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:43.842510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:43.843454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:43.844577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:43.845109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:43.846239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:43.846786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:43.849527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:43.860498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 486/956] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:43.870210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:43.995766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:44.048934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40705fe-5646-4119-97ba-a6cd81aa31c0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:44.061479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:44.126976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:44.127914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:44.128464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:44.129162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:44.130419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:44.133214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:44.174361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 471/957] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:44.186225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59052791-5b40-49bc-92b5-99237b4f5282 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:44.267442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:44.269151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:44.269940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:44.270729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:44.272156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:44.275286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:44.292623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:44.294435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:44.296117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:44.301836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 487/958] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:44.312282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:44.331265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:44.458059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fab7d-893b-4201-992b-253521e449f9 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:44.497428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:44.498067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:44.498345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:44.498621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:44.499446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:44.499754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:44.501758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656c93-27e7-4d45-83c6-73e1a44572e0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:44.507819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 472/959] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:44.513464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:44.697305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151b1a-c83b-43a9-a362-cc537222392b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:44.699010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:44.736984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:44.737603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:44.737881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:44.738155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:44.738796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:44.739100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:44.740496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3129-e16c-498e-8631-028552a08f04 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:44.746736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 488/960] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:45.067025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ea5-c8e0-4ce4-b61e-05f85ca3f5f8 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:45.067841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ea5-c8e0-4ce4-b61e-05f85ca3f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:45.067841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea56ea5-c8e0-4ce4-b61e-05f85ca3f5f8 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:45.069389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 473/961] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:45.076725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:45.077691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:45.077922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:45.102650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:45.103885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:45.181510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 489/962] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:45.463303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56ea5-c8e0-4ce4-b61e-05f85ca3f5f8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:45.545081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:45.589644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea56ea5-c8e0-4ce4-b61e-05f85ca3f5f8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:45.632358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:45.633030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:45.633313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:45.633579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:45.634257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:45.635765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:45.654628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.sql.core [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:09:45.654628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:09:45.654628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [parameters: {'user_id': '13103b3b329b4f898abbb0ba6ab895f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:09:45.654628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81714) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result.read() Aug 23 22:09:45.663539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:09:45.665012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application yield resource Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise self.value Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application session.commit() Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:09:45.668939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:09:45.677255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:09:45.680085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application result.read() Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:09:45.682884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [parameters: {'user_id': '13103b3b329b4f898abbb0ba6ab895f6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:45.686152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 22:09:45.689230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:45.692636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 474/963] 10.222.0.69 () {60 vars in 1131 bytes} [Tue Aug 23 22:09:45 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:45.694120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:45.805335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:45.813994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12a44-12d1-4f6b-9ae1-b62777f58e9d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:45.860056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:45.861150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:45.861447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:45.861686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:45.871065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:45.872778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-37869454-2ab0-4dec-8cab-0b596fee17aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:45.888232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:45.892013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:45.901796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 490/964] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:09:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:45.904050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:46.027543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0ea77-06e3-4bba-ae60-779d6c726923 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:46.060730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:46.068117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:46.069315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.069315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.069789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.070180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:46.070732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:46.072464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e409ee-b66c-40f8-880a-bc88754331ec None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:46.134541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 475/965] 10.222.0.69 () {56 vars in 1101 bytes} [Tue Aug 23 22:09:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:46.517532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08036-a85c-4cba-a152-59f469be4318 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.518095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08036-a85c-4cba-a152-59f469be4318 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.518095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad08036-a85c-4cba-a152-59f469be4318 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.519435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 491/966] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:46.525457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05c0a-6b74-4f60-a744-9a0356aa6a3c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.525753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05c0a-6b74-4f60-a744-9a0356aa6a3c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.526105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05c0a-6b74-4f60-a744-9a0356aa6a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.548342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fad05c0a-6b74-4f60-a744-9a0356aa6a3c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:46.550039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fad05c0a-6b74-4f60-a744-9a0356aa6a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:46.627975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 476/967] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:46.791778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810deac-e821-4905-b764-f10e5b3bb72e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.792054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810deac-e821-4905-b764-f10e5b3bb72e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.792479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810deac-e821-4905-b764-f10e5b3bb72e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.794144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 492/968] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:46.800429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0524-a800-4dd4-986b-139cfdfa0d94 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.800801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0524-a800-4dd4-986b-139cfdfa0d94 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.801005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e0524-a800-4dd4-986b-139cfdfa0d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.827448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bd4e0524-a800-4dd4-986b-139cfdfa0d94 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:46.829715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bd4e0524-a800-4dd4-986b-139cfdfa0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:46.907138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810deac-e821-4905-b764-f10e5b3bb72e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:46.948917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 477/969] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:47.042400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810deac-e821-4905-b764-f10e5b3bb72e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.086071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.086768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.087047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.087351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.092887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc34f-ab9d-4280-8f09-00e8fb4de6fe None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.094248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc34f-ab9d-4280-8f09-00e8fb4de6fe None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.094248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fc34f-ab9d-4280-8f09-00e8fb4de6fe None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.095808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 478/970] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:47.101335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.101692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.101870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.108427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:47.118635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:47.120562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:47.122388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 493/971] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:09:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:47.126974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:47.127706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.128852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:47.150689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.196418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.229770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 479/972] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:47.290106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.299905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c0c0b-c812-451c-ad91-68ee0982a959 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.354713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.355662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.356117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.356550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.357690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:47.358235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.360747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.375795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 494/973] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:47.381342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.469548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f2eb6-3c79-44ea-9433-c64f2fa2b6db None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.507377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.508038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.508311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.508578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.508935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.509290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.510716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:47.522811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:47.524788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:47.526513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 480/974] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:47.532790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.547866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee918c2-ee9e-4518-9910-d1f345909ef8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.584591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.590464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.591243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.591509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.591779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.605729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.607507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:47.623702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:47.624741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:47.627046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:47.627046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:47.627046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:47.627046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 495/975] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:47.631277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.662036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5926bb-b558-4f1b-b318-87baab913270 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.701343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.702246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.702521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.702788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.704441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:47.705042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.706917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.718269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 481/976] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:47.720546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.769061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06981b16-e263-483c-ab89-d6645eac3a98 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.801034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.808965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.809587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.809867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.810133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.810789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:47.811092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.812576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.830370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 496/977] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:47.831760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.878969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03241c-682e-47a3-886d-04f7a44dc822 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.888477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.934816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.935766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.936209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.936656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.938281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:47.938704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.940971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.949482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 482/978] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:47.950363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.970892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c557ec0-9509-4e4a-bb12-d17e5e1bbbd2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.027399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.028256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.028695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.029162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.030255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.033201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:48.053926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 497/979] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:47 2022] POST /identity/v3/services => generated 242 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:48.055328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:48.106653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da91c-cef3-4313-a061-3b6503937868 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.155120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:48.193425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.194623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.195120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.195616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.212557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.215413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:48.240426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:48.242119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:48.243471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 483/980] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:48.244390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c080f-1bc0-4ea3-a363-05985828505e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.253682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:48.291702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.292661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.293160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.293594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.294787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] RBAC: Adding query filter params (interface=admin, service_id=c799b8451e58480383c0889ff248b2dc, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:48.300837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.300837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:48.307110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 498/981] 10.222.0.69 () {56 vars in 1249 bytes} [Tue Aug 23 22:09:48 2022] GET /identity/v3/endpoints?service_id=c799b8451e58480383c0889ff248b2dc&interface=admin®ion_id=RegionOne => generated 193 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:48.307405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:48.316525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:48.462978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669dab12-6175-4fb5-86ae-34cc2ff0b1ce None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.506107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a129148-e5ff-4bda-aa16-6625070d912d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.529762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:48.532802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.534058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.534564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.535275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.537224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:48.538132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.541818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:48.567727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.568837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.569141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.569596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.570594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.573112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:48.574758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 484/982] 10.222.0.69 () {56 vars in 1149 bytes} [Tue Aug 23 22:09:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:48.581110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:48.596911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 499/983] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:48 2022] GET /identity/v3/services => generated 1727 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:09:48.706716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:48.739292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f555bde-0201-4bd9-a6e6-684138220deb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:48.783764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:48.784693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:48.785156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:48.785576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:48.877575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:48.879646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:49.016461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:49.053653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 485/984] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:48 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:09:49.055017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:49.178852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a200-61db-4bd2-a10d-fff7ad83a4f7 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:49.218497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:49.219666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:49.219947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:49.220220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:49.232447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:49.233959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:49.252027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:49.253094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:49.254013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:49.254013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:49.254013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:49.254013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 500/985] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:49.259116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:49.381428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8245-3098-499e-992c-a3d2d9780fe1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:49.431302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:49.432329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:49.432870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:49.433349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:49.434219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:49.434728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:49.436324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:49.450280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 486/986] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:49.456492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:49.494493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:49.608580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab116488-2e0d-4db7-91c0-a471b72ef2d2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:49.668706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:49.669652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:49.670091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:49.670565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:49.682982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:49.685570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:49.707060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:49.708942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:49.711603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 501/987] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:49.715887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:49.777860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:49.855182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f3e2a-11e5-458e-9942-01c1d948cc33 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:49.897665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:49.898277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:49.898554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:49.898841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:49.899614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:49.899897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:49.906018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694b7bd-5d12-4fad-9881-4c02002ea56f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:49.924927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 487/988] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:49.928130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:50.035528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:50.048785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e23cd-4df6-49d0-aa20-992e0d7326a6 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:50.099207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:50.100216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.100702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.101251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.101872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] RBAC: Adding query filter params (role.id=913f363b1b2d40d887716c604d7c9e52, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=61a775a6854049d7b75a54aab8d448a4) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:50.102384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:50.104327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf19ac8-0146-4a50-8c47-f505a36a53e4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:50.115073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 502/989] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:49 2022] GET /identity/v3/role_assignments?user.id=61a775a6854049d7b75a54aab8d448a4&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=913f363b1b2d40d887716c604d7c9e52 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:50.588029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986007-1dc7-49de-af90-ec127d7cf70c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.588845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986007-1dc7-49de-af90-ec127d7cf70c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.588845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43986007-1dc7-49de-af90-ec127d7cf70c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.590169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 488/990] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:50.596347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7ebe-344c-4eb6-be45-98e7beae40d3 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.596756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7ebe-344c-4eb6-be45-98e7beae40d3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.596960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b7ebe-344c-4eb6-be45-98e7beae40d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.616669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-961b7ebe-344c-4eb6-be45-98e7beae40d3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:50.617947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-961b7ebe-344c-4eb6-be45-98e7beae40d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:50.705590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 503/991] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:50.793879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6bef-9f6b-4892-b2f8-1f64b6e95085 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.794151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6bef-9f6b-4892-b2f8-1f64b6e95085 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.794419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6bef-9f6b-4892-b2f8-1f64b6e95085 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.795790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 489/992] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:50.801566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.801857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.802137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.823643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:50.824874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:50.953888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 504/993] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:50.997834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d6bef-9f6b-4892-b2f8-1f64b6e95085 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.165216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d6bef-9f6b-4892-b2f8-1f64b6e95085 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.169260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.222539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.223614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.224120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.224605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.225476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.227288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:51.238820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:51.240016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:51.241091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:51.243503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 490/994] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:51.245451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.251087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.265834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.387025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1294de-da3c-43f1-88ea-5aab99c96356 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.412768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e815b66-473e-4e51-94da-345201b86ac7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.436526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.437215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.438077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.438476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.439278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.440694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:51.451054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:51.453999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:51.457679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 505/995] 10.222.0.69 () {56 vars in 1126 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:51.460282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.481739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.482464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.482808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.483221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.483964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.484891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.486793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.493229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 491/996] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:51.501313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.554153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.601662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.630641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b75419-1931-4ef5-8f3a-5cb22a8771ad None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.645884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaed2dd-6163-4c8a-a550-7d9c809f5345 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.681920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.682719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.683119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.683581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.685561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.685561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.686958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.696847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 506/997] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:51.706778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.711617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.712252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.712534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.712842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.713460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.713773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.715133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.729012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 492/998] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:51.730454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.841205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06d772-a844-4087-80af-336e798a30f2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.897732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.899172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.900226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.900852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.901133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.901822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.902132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.903677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.910108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9ce8e-b353-4fb5-9327-bc791d89ca9f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.911259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 507/999] 10.222.0.69 () {56 vars in 1122 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:51.917857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.930553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.963700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.964387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.973021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.973021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.973021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] RBAC: Adding query filter params (interface=public, service_id=6625cac4d39e44b3a005dc6c4cfa8588, region_id=RegionOne) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.973021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.973021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.981614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 493/1000] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/endpoints?service_id=6625cac4d39e44b3a005dc6c4cfa8588&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:51.987534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:52.065802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfe10-03d0-4341-b4eb-b336f9e2ee52 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.126130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.126872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.127152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.127419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.128115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.130304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeaea15-2a78-4209-b0f7-e7d34a9f8032 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.147668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56348a-0bd6-48b5-a02f-8e86b98d107d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.164841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 508/1001] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:52.206832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.207470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.207757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.208033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.208662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.210110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98c990-ea5d-47de-8a84-06831534a1af None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.217256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 494/1002] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/services => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:09:52.373676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5019-2cd4-4e01-b829-bfb800cf876f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.373676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5019-2cd4-4e01-b829-bfb800cf876f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.374371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5019-2cd4-4e01-b829-bfb800cf876f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.376077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 509/1003] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:52.382367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b362-158d-4030-b372-138fd511b423 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.382571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b362-158d-4030-b372-138fd511b423 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.382837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b362-158d-4030-b372-138fd511b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.403563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4010b362-158d-4030-b372-138fd511b423 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:52.405102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4010b362-158d-4030-b372-138fd511b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:52.425028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.511077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 495/1004] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:52.955000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5019-2cd4-4e01-b829-bfb800cf876f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:53.070370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:53.138009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5019-2cd4-4e01-b829-bfb800cf876f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:53.187099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:53.188664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:53.189190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:53.189628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] PATH_INFO: `/v3/services/image` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:53.190377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:53.191919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:53.204500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:53.206066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:53.207374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:53.209142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 510/1005] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 23 22:09:52 2022] GET /identity/v3/services/image => generated 86 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:53.216415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b362-158d-4030-b372-138fd511b423 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:53.418918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b362-158d-4030-b372-138fd511b423 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:53.486919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:53.487852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:53.488345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:53.488831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:53.489975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] RBAC: Adding query filter params (name=image) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:53.490513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:53.493111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a6e83-72f9-471f-887a-9ba15eb78068 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:53.503319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 496/1006] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:53.512339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:53.702056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0388227-7f1b-4a3f-b358-6d06106d2011 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:53.757077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:53.769531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:53.770556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:53.771057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:53.771540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:53.772622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] RBAC: Adding query filter params (type=image) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:53.773222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:53.775826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806d985-282e-4051-b26e-03ea2d6da884 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:53.785413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 511/1007] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:54.599853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302827-01b7-4799-b8f7-b6762a1aea7f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:54.600708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302827-01b7-4799-b8f7-b6762a1aea7f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:54.600708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302827-01b7-4799-b8f7-b6762a1aea7f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:54.602891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 497/1008] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:54.609073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21c4bf-6ec7-449b-b12c-c7f75ea64ed5 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:54.610567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21c4bf-6ec7-449b-b12c-c7f75ea64ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:54.610567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21c4bf-6ec7-449b-b12c-c7f75ea64ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:54.631566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3d21c4bf-6ec7-449b-b12c-c7f75ea64ed5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:54.633125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3d21c4bf-6ec7-449b-b12c-c7f75ea64ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:54.721410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 512/1009] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:55.004488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302827-01b7-4799-b8f7-b6762a1aea7f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.023001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:55.131565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302827-01b7-4799-b8f7-b6762a1aea7f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.132308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaea835-8896-4cbc-a19d-99e2c62ae433 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.132796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaea835-8896-4cbc-a19d-99e2c62ae433 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.133292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaea835-8896-4cbc-a19d-99e2c62ae433 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.135812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 513/1010] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:55.142311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.142575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.142918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.165079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:55.166341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:55.205275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.206384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.206886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.207378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.208468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:55.211269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:55.231958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:55.233992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:55.237210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 498/1011] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:55.241456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.264050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 514/1012] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:55.411966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:55.461229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adfa3e-7d56-4e42-82f4-c8fa739b873c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.527307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.528036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.528439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.528869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.529929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] RBAC: Adding query filter params (name=compute) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:55.530463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:55.534028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:55.543544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 499/1013] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:55.553233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.598034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.643188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:55.729466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176cb2-7cd6-4e56-a856-e644196df495 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.792493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1572b-115c-4745-8f54-b4f104256dab None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.804607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.805290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.805562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.805826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.806471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:55.806815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:55.808223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:55.819451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 515/1014] 10.222.0.69 () {56 vars in 1112 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:55.821097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.866532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.867357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.867782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.868270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.870327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:55.872886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:55.876859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 500/1015] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:55.882862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.907191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.015512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493b4dd-e83c-47c2-a1cc-9d3e60acb319 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.042931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.069589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.070532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.070940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.071339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.072430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.074222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e885f4e-14d7-4d56-9c8b-0fe1d8e9aada None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.083109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b2081-4e7e-4d59-86bf-fdb31d475bee None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.105264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 516/1016] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:09:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:56.166859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.167854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.168311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.168740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.169922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.173193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988729be-6c56-40fd-a199-7d3576c96a02 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.235842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 501/1017] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:55 2022] POST /identity/v3/projects => generated 311 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:56.391726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798513c6-d908-418f-94cd-78e448a7e65c None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.391925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798513c6-d908-418f-94cd-78e448a7e65c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.392188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798513c6-d908-418f-94cd-78e448a7e65c None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.393991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 517/1018] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:56.399960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5df4-d718-4cf7-9bcb-2d17f4484c9f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.400270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5df4-d718-4cf7-9bcb-2d17f4484c9f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.400515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a5df4-d718-4cf7-9bcb-2d17f4484c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.422819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b74a5df4-d718-4cf7-9bcb-2d17f4484c9f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:56.424123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b74a5df4-d718-4cf7-9bcb-2d17f4484c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:56.520518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.550172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 502/1019] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:56 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:56.826219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798513c6-d908-418f-94cd-78e448a7e65c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:57.022490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798513c6-d908-418f-94cd-78e448a7e65c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:57.090401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:57.091377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:57.091889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:57.092398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:57.094914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:57.097659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43295fae-ddd4-4195-b52d-9afc6d40bf78 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:57.120930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 518/1020] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:09:56 2022] POST /identity/v3/services => generated 242 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:09:58.898166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b551e-9e62-41fa-8ebf-a608e01d59e2 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:58.899001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b551e-9e62-41fa-8ebf-a608e01d59e2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:58.899001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b551e-9e62-41fa-8ebf-a608e01d59e2 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:58.900863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 503/1021] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:58.909378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985593b-8931-45de-9108-ec2e72d15421 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:58.910007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985593b-8931-45de-9108-ec2e72d15421 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:58.910405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985593b-8931-45de-9108-ec2e72d15421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:58.941385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b985593b-8931-45de-9108-ec2e72d15421 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:58.943390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b985593b-8931-45de-9108-ec2e72d15421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:58.989024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:59.078186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 519/1022] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:59.226663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3418b-5493-4713-97d0-82922dacd00c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.226860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3418b-5493-4713-97d0-82922dacd00c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.227166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3418b-5493-4713-97d0-82922dacd00c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.227651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a79e-072c-4665-a8a9-2d5e77aa3ffe None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.227931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a79e-072c-4665-a8a9-2d5e77aa3ffe None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.228184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a79e-072c-4665-a8a9-2d5e77aa3ffe None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.228840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 504/1023] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:59.229923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 520/1024] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:59.235183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.235512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.235638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.235723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.236037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.236310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.255790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:59.256725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:59.257053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:59.257935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:59.346165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 505/1025] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:59.352044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 521/1026] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:09:59.574392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:59.622932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:59.741440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730104c-cb71-4a2f-a321-38a9f9daef4f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:59.743478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:59.761628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0614-a92b-4f6b-8b0d-b4240c0d49f9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:59.772335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:59.804056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:59.805019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.805390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.806226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.814886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:59.815980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.816474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.816992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] PATH_INFO: `/v3/services/image` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.818102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:59.820859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:59.823489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:59.831828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:59.833753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:09:59.835681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:59.838870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:59.841364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:09:59.844733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:09:59.846933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 506/1027] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:09:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:59.846933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:59.847234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 522/1028] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 23 22:09:59 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:59.847234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.004683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5a84f-9eb6-4f7e-9971-f2650dee569c None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.010259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623a3e4-6cff-487a-959a-1bfa37afc4de None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.045868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.047106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.047420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.047667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.049101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.050694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.051970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.052327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 507/1029] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.052603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.052915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.053156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.053335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.053808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.054115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.055492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.069160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 523/1030] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:09:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.069789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.092377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.113589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.194350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b166-4139-4403-b3da-f02c1a33e70d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.198835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3b051-9cbd-4840-8d70-8643dfd9de8f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.250581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.251645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.252141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.252622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.253846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] RBAC: Adding query filter params (name=image) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.254382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.256015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.256346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.257119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.257564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.257981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.258769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.260338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.267279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 508/1031] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.267558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.287846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 524/1032] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:10:00 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:00.289311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.431702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.439249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b714f00-1766-4131-af44-3ee1d1f6747b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.457388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.489936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be105e-6502-4a0a-aa9d-cf6ae4be7c48 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.497910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.499013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.499528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.500028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.517976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.520247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.536344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.536564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.536902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.537174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.541279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] RBAC: Adding query filter params (type=image) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.541279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.541798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:00.548366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:00.551177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:00.553331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:00.553331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:00.553331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:00.553849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 525/1033] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.554008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 509/1034] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:00.555084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.564339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.710729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a55760-61d0-4ce5-9270-1e15cccb14bc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.716641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58a6d5-71ee-4656-bbe8-6c2ad5692d26 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.759791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.760429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.760706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.761093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.761965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] RBAC: Adding query filter params (interface=public, service_id=1a078c72f3094fb78f4b58dcd6934b9b, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.762274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.764374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.768847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.774272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 526/1035] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/endpoints?service_id=1a078c72f3094fb78f4b58dcd6934b9b&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:00.783648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.786241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.786876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.787192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.787537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.788232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.788536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.790058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.804562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 510/1036] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.811055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.844168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.953862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bc97e-2eae-4cbe-ace0-d7fad3238b9b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.955268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5c00c-dbf2-4617-a776-d4b9f25ea559 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.994868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.995453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.995927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.996272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.005655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.007171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:01.020523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:01.022671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:01.024906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 511/1037] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:01.027631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.029064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.031660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.032338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.033158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.034280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.037029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.060847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 527/1038] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/services => generated 1957 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:10:01.170035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.208259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb99a72-f754-4e94-be26-eae8cce9a8e3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.263718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.265092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.266194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.266907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.268074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:01.268692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.270852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.292881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 512/1039] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:01.302531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.425435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.510086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5391435-f45f-4b26-a9a9-56f5c1038ea1 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.572553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.573867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.574322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.574961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.694333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.697108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.810835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.889656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 528/1040] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:01.895295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.069014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0662423-1f18-42da-8bbd-964ab492fff1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.112989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.113639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.113909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.114232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.123930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:02.128853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.130411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:02.158282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:02.160116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:02.167035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:02.167035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:02.167035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:02.167035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 513/1041] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:02.172343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.335888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611ac77-df3f-4d4f-aaf9-f86502fa9526 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.387877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.388656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.389195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.389687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.391324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:02.391930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.395575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed558bf-dfdf-47cb-95ef-f2366eeae5e9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.418618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 529/1042] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:02.427207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.587040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f089-73db-41a4-873b-542fabcd6f4e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.587312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f089-73db-41a4-873b-542fabcd6f4e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.587715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811f089-73db-41a4-873b-542fabcd6f4e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.589328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 530/1043] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:02.596434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.596749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.597107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.604331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff787e2-abd6-443c-9441-83eaacb22162 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.617698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:02.619034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:02.640589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:02.660687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.661441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.661735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.661983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.672437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.674209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:02.689805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:02.692102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:02.693799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 514/1044] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:02.698078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.714978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 531/1045] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:02.807450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:02.898197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea95e2-bf5f-4862-9f2c-563b3edea5dd None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.963928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.965343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.966038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.966729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.968965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:02.969743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.972483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.996933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 515/1046] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:03.003343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:03.032544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:03.187108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cce9e-9d57-41b4-9882-3f5b76c199b6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:03.197462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03c64b-52d6-4668-9909-70b4f7a0c613 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:03.206997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:03.245345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:03.246183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.246587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.246990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.261020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:03.261738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.262171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.262669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.263107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:03.263990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] RBAC: Adding query filter params (role.id=913f363b1b2d40d887716c604d7c9e52, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:03.264554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:03.267414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:03.268596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:03.269624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:03.274701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 516/1047] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:03.277092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:03.283806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 532/1048] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:03 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=913f363b1b2d40d887716c604d7c9e52 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:03.452675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a187403-218f-4d98-9704-744ef2f2f9b3 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:03.504654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:03.505563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.506018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.506445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.507278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:03.507735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:03.509477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385fbdc-084e-402b-99d4-1f7d7aeb8050 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:03.520786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 517/1049] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:03.527275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:03.551916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:03.617282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3824-362d-4e36-a17e-8b6fe039584a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.617544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3824-362d-4e36-a17e-8b6fe039584a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.617830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3824-362d-4e36-a17e-8b6fe039584a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.619424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 518/1050] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:03.625376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.625763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.625967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.648621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:03.649888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:03.679157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d553b9-b304-4e2f-a774-2581b7f8b200 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:03.689298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:03.726918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:03.727558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.727843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.728147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] PATH_INFO: `/v3/users/a39e69ea24364beb82c90a4ff532f364` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.744458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 519/1051] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:03.750875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=a39e69ea24364beb82c90a4ff532f364)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:03.753362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:03.763272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 533/1052] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:03 2022] GET /identity/v3/users/a39e69ea24364beb82c90a4ff532f364 => generated 285 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:03.765747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:03.897350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6db1c1-8f14-4ad3-bbe2-6d8e16bfea59 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:03.941211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:03.942174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:03.942606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:03.943017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:03.989220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:04.012799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.043237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.045980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.127187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:04.166505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64e6dd-c48f-4e5f-823c-4995b0e70eb4 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.200598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 520/1053] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:03 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:10:04.202418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.209404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.210265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.210265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.210538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.211263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.212729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:04.223004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:04.224373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:04.225612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 534/1054] 10.222.0.69 () {56 vars in 1105 bytes} [Tue Aug 23 22:10:04 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:04.230121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.303322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:04.353306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fec81-da5b-4925-81ac-427f1960353e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.394769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f978-27cf-45d1-a444-81b3f43fdfa0 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.422477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.423145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.423409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.423678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.424917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.426381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.428100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 521/1055] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:04 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:04.437166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.476368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.477580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.478137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.478738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.479987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:04.480607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.483428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.497399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 535/1056] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:04.502600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.509575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:04.625420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917f89e-e033-4b18-9e60-47015e1532f1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.669331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:04.676238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.676893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.677288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.677603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.678743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb, user.id=a39e69ea24364beb82c90a4ff532f364) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:04.679085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.680877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.688500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 522/1057] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:04 2022] GET /identity/v3/role_assignments?user.id=a39e69ea24364beb82c90a4ff532f364&scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:04.688773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74012f45-c480-478e-b919-712869f2d8e2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.751592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.752292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.752724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.753072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.753763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] RBAC: Adding query filter params (type=image) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:04.754115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.755930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc13e8-0a29-420e-a91b-d2805414a0fb None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:04.762980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 536/1058] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:04.770404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:04.921327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4174-9548-4ac9-8cf6-39ba07bfdaeb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:04.963679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:04.964303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.964583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.964875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.965554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:04.966951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdc3e9-355c-4d15-956a-b8d1a497259e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:05.000850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 523/1059] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:10:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:05.544668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35f87-7f84-47c0-96eb-7bdc3dc11f1e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:05.545279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35f87-7f84-47c0-96eb-7bdc3dc11f1e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:05.545361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc35f87-7f84-47c0-96eb-7bdc3dc11f1e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:05.548364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 537/1060] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:05.554339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:05.554887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:05.554887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:05.586435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:05.588520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:05.691928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:05.751486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 524/1061] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:06.150590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc35f87-7f84-47c0-96eb-7bdc3dc11f1e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.264609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.320545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc35f87-7f84-47c0-96eb-7bdc3dc11f1e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.389805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.391488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.392001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.395634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.419697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:06.426098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:06.429128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:06.430059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 538/1062] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:06.437194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.580387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dca35d-c16c-408d-bb1c-a792a97a4863 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.622483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.623115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.623396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.623669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.624361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:06.625240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.627185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7234b-77b1-4ca4-933f-d91532aa7003 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.637572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 525/1063] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:06.645204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.784273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cec7d-76b1-42f1-a4f2-168933e32530 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.784954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cec7d-76b1-42f1-a4f2-168933e32530 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.785526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cec7d-76b1-42f1-a4f2-168933e32530 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.788092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 526/1064] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:06.797385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.798507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.798507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.827357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:06.830004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:06.844921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17e6f-dacf-4b88-a0db-349ae222de44 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.888946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.891745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.905670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.906732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.907150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.907624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.920878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.923234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.940003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 527/1065] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:06.940432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:06.942164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:06.943932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:06.943932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:06.943932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:06.943932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 539/1066] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:06.950801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.075942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120f2ee-b914-487f-863e-612dc5777639 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.118105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.118721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.118996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.119277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.119914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.120211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.121627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.136173 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 528/1067] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:07.142634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.243974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.283375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfccc6-85cc-4a20-967a-a42f88074384 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.292294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.348013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.348901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.349325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.349751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.364228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.366996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.378009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e6d8-a2c5-49ca-9439-02ecd7218b6b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:07.391422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:07.392456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:07.393473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:07.397999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 540/1068] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:07.401214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.457256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.458234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.458736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.459239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.467540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.482260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:07.493096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:07.494791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:07.498224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 529/1069] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:07.503959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.581241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6b5b4-9a96-4444-be7e-cbd91997f7e8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.636831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.637634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.638004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.638341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.639333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.639706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.642212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73947a90-dcb3-4c1d-bace-24b927aee393 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.663107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.663856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 541/1070] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:07.665258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5737-5948-4038-84e0-58d173b57b16 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.665555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5737-5948-4038-84e0-58d173b57b16 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.666376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f5737-5948-4038-84e0-58d173b57b16 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.667206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 542/1071] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:07.672863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5737-5948-4038-84e0-58d173b57b16 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.681520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692225c2-2653-4749-a2ba-06aac3bdb68a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.727603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.728237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.728508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.728785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.729540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.729844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.731336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb842e-d9d3-49db-b995-263a3615311c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.743209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 530/1072] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:07.745864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.746307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.746746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.773479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:07.774763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:07.812740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.821355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f5737-5948-4038-84e0-58d173b57b16 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.864787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.865128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 531/1073] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:07.865468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.865747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.865899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.866050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.880968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.882494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:07.907756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:07.909654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:07.911466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:07.911466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:07.911466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:07.911466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 543/1074] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:07.915273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.013497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.043403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a173a7d-ee21-4cd1-9661-6feb74a967cf None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.088048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8af7f8-dba6-4e9c-ba25-972b5597a04f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.106064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.107416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.108240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.109728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] PATH_INFO: `/v3/users/a39e69ea24364beb82c90a4ff532f364` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.111611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=a39e69ea24364beb82c90a4ff532f364)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.113118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.116941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 532/1075] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/users/a39e69ea24364beb82c90a4ff532f364 => generated 285 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:08.121742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.145690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.146653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.146927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.147239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.148341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:08.148881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.151672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.169110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 544/1076] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:08.179236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.200376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.272577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dc6c6-50dd-4151-a3e8-d71ecdb75ce4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.322582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.323443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.323893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.324339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.326260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.329811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.332369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 533/1077] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:08 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:08.333764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.335126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036eb6-b41d-47fe-bf26-5fcb00494c48 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.365760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.391047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.391811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.392087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.392356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.401355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.402840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:08.415205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:08.416574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 545/1078] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:08.418260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.506778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc43112-5920-4db1-8d53-06fb6bc487e6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.549201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.554786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.556200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.556200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.556200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.592353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37284b2-ac35-47cd-9599-818b415c6ed9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.645096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.645945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.646486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.646855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb/users/a39e69ea24364beb82c90a4ff532f364/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.649393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] RBAC: Authorizing `identity:create_grant(project_id=9b2ea89ac2ef489581549d9a5bc64ffb, user_id=a39e69ea24364beb82c90a4ff532f364, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.651085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.655544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.658234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.668961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 546/1079] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:10:08 2022] PUT /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb/users/a39e69ea24364beb82c90a4ff532f364/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:10:08.670381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.707244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.851812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c592fc3-23d1-485a-ade0-dae1d3d4666d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:08.855086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 534/1080] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:08.864838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:08.905391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:08.918982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:08.918982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:08.918982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:08.919363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:08.919943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:08.922698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:08.925485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:08.950054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 547/1081] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:08.958893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:09.068350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b4a1c-ccb8-4ac4-bfc6-d652dec42fa1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:09.104299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:09.139050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:09.141174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:09.141767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:09.142246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:09.162953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:09.165695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:09.167467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d3043-3a8b-4ba7-83da-e4db62c0567d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:09.196224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:09.198150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:09.200690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:09.200690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:09.200690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:09.200690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 535/1082] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:09.207078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:09.235929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:09.237015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:09.237290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:09.237597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/913f363b1b2d40d887716c604d7c9e52` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:09.239878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=c21fbe153d904a19be3b27c499c4f88e, role_id=913f363b1b2d40d887716c604d7c9e52)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:09.241370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82da32-d7f7-4285-80aa-a0a68bdae29d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:09.268965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 548/1083] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:10:08 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/c21fbe153d904a19be3b27c499c4f88e/roles/913f363b1b2d40d887716c604d7c9e52 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:10:09.386204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a14290-57a6-428c-8d6d-01bd1be3d9c8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:09.467842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:09.469470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:09.469971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:09.470422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:09.471625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:09.472166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:09.474922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff59d9b-6137-46f7-bb07-9abea3af869c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:09.501422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 536/1084] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:11.572520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf12f-fa77-41a4-83d3-cc8b742d528f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.573371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf12f-fa77-41a4-83d3-cc8b742d528f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.573556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf12f-fa77-41a4-83d3-cc8b742d528f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.576002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 549/1085] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:11.586674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebad15-0e36-4a56-b023-17b9ef6425ff None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.587550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebad15-0e36-4a56-b023-17b9ef6425ff None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.587719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebad15-0e36-4a56-b023-17b9ef6425ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.620168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-44ebad15-0e36-4a56-b023-17b9ef6425ff None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:11.622415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-44ebad15-0e36-4a56-b023-17b9ef6425ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:11.674526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:11.767880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 537/1086] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:12.283266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bf12f-fa77-41a4-83d3-cc8b742d528f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:12.390310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:12.504673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bf12f-fa77-41a4-83d3-cc8b742d528f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:12.548197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057b61-cbc3-4f42-aa81-1dbf6378a3c4 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:12.548544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057b61-cbc3-4f42-aa81-1dbf6378a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:12.549057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af057b61-cbc3-4f42-aa81-1dbf6378a3c4 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:12.551803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 538/1087] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:12.561271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:12.561740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:12.562238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:12.588491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:12.589588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:12.590066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:12.590535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:12.595065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:12.597276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:12.613295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:12.622314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:12.625551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:12.627629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 550/1088] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:12.634584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:12.731366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 539/1089] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:12.815549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d4367-4ee8-44c4-b2dc-e7149780648f None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:12.831933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:12.879845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:12.880930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:12.881413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:12.881909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:12.882997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:12.883691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:12.886385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:12.910906 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 551/1090] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:12.913443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.096989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:13.117446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34220093-cc9f-4b0b-86da-39eb6d7397ae None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.146643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.171972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.172614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.172932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.173258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] PATH_INFO: `/v3/users/a39e69ea24364beb82c90a4ff532f364` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.174545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] RBAC: Authorizing `identity:get_user(user_id=a39e69ea24364beb82c90a4ff532f364)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:13.176023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:13.178058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 540/1091] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:12 2022] GET /identity/v3/users/a39e69ea24364beb82c90a4ff532f364 => generated 285 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:13.187457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.323571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3b554-5dd5-46a3-a449-9b3dd265a4aa None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.354898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef32ff7-2eb6-4bbc-a2ab-58b01ed65e4d None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.388633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.389765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.390295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.390794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.410064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.411065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.411546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.412037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.415447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:13.425625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:13.426749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:13.427738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 552/1092] 10.222.0.69 () {56 vars in 1120 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:13.437696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.466761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:13.497653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:13.548989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:13.551808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:13.621150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe34a8-6b8f-47ae-9026-73d37af4b428 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.663682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.664554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.665038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.665477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.666595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:13.667093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:13.669329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:13.685350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 553/1093] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:13.695499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.741602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 541/1094] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:10:13.743183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.825411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:13.860598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:13.873595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b3045-f3a8-42be-a6a7-4a208401ef8a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.901732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab9133-52cb-437d-acc7-e48013e90cd1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:13.926555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.927630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.928119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.928607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.949779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:13.952543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:13.967423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:13.969071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:13.969580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:13.970063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:13.972134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:13.974836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:13.978329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 542/1095] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:13.980767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:13.981986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:13.983132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:13.983132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:13.983132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:13.984983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 554/1096] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:13.989167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:13.993193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.144146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443d780-c669-43ce-b60b-cbdec9a8c0bc None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.159014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e5587-90d2-4b6a-ae66-30903895a1dc None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.192154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:14.207156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.208115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.208565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.209006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.210290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb, user.id=a39e69ea24364beb82c90a4ff532f364) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:14.210712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:14.213280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:14.217964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.219680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.220126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.220564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.221690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:14.222165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:14.224562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:14.224779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 543/1097] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/role_assignments?user.id=a39e69ea24364beb82c90a4ff532f364&scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:14.246832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 555/1098] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:14.254053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.441745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a61fa-ceb2-4ca7-9d8e-a7871e434703 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.503602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.504691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.505224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.505684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.522374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:14.525202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:14.548370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:14.550296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:14.552204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 544/1099] 10.222.0.69 () {56 vars in 1093 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:14.560178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.577251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:14.706697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b55200-2a18-419a-8e6c-abb585710b4b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.744317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.744965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.745244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.745516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.746261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:14.746566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:14.748007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:14.770668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 556/1100] 10.222.0.69 () {56 vars in 1133 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:14.776662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.842419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:14.902283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed4101-25c6-4f29-bf17-011d60d3ba60 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.946647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.947390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.947762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.948122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.027683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.029492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.088379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.151798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 545/1101] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:10:15.158911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.230952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.279652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40bb0-441b-4397-adba-7761bc768087 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.321074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.321870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.322237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.322600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.337127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.338762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:15.356546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:15.358455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:15.361353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:15.361353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.361353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:15.365130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 557/1102] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:15.366406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.489695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22597ee-e00a-4b71-bb8e-5478a7fd13a0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.531177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.531792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.532141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.532481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.533274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:15.533645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.535167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.549341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 546/1103] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:15.555788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.730407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41167362-129e-4d79-83db-c2864ba886bf None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.764033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.795316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.795878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.797088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.798084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.805230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.806715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:15.821233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:15.823097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:15.824937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 558/1104] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:15.831324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.852284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:16.016898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09664a-f5b0-4f7c-96d5-3445662ffffa None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.078821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.079694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.080154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.080612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.081844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:16.082351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.084912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02385a2b-811c-4eb5-aad3-439525573377 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.107239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 547/1105] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:16.118008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:16.315732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0679c23-8471-41f1-a4fe-1237d58c9533 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.382939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.383861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.384327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.384772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.386004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] RBAC: Adding query filter params (role.id=913f363b1b2d40d887716c604d7c9e52, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=c21fbe153d904a19be3b27c499c4f88e) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:16.386500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.389306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4a552-0381-4e28-8229-81b4280fd6de None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.401174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 559/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:16 2022] GET /identity/v3/role_assignments?user.id=c21fbe153d904a19be3b27c499c4f88e&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=913f363b1b2d40d887716c604d7c9e52 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:17.483081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13e9f-95e7-4524-acb0-477fffd7b41f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:17.484345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13e9f-95e7-4524-acb0-477fffd7b41f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:17.484522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb13e9f-95e7-4524-acb0-477fffd7b41f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:17.486891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 548/1107] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:17.495306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:17.496098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:17.496255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:17.531529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:17.533803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:17.603901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:17.652791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 560/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:18.192272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13e9f-95e7-4524-acb0-477fffd7b41f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:18.328942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:18.395056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb13e9f-95e7-4524-acb0-477fffd7b41f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:18.467079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:18.468051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:18.468534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:18.469261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:18.471326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:18.474095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126dbd53-e620-4ed2-939b-733bdce70e9f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:18.477143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 549/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:18.487403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:18.679489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc90c-6a0f-458c-b681-1c4a124e51f4 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:18.746837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:18.747759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:18.748234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:18.748728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:18.750334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:18.753092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd503-9f49-4a48-a30b-45e14f410f90 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:18.792064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 561/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:10:18 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:20.961532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcdbc-f277-4a9e-af1a-88b0d87249d1 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:20.962365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcdbc-f277-4a9e-af1a-88b0d87249d1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:20.962520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdcdbc-f277-4a9e-af1a-88b0d87249d1 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:20.964421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 550/1111] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:20.983689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86354f-539c-42a7-aa5f-99088778689b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:20.984789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86354f-539c-42a7-aa5f-99088778689b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:20.985223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86354f-539c-42a7-aa5f-99088778689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:21.014786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-db86354f-539c-42a7-aa5f-99088778689b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:21.017483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-db86354f-539c-42a7-aa5f-99088778689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:21.059017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:21.155431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 562/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:21.505110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcdbc-f277-4a9e-af1a-88b0d87249d1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:21.662505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdcdbc-f277-4a9e-af1a-88b0d87249d1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:21.722035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:21.722762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:21.723215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:21.723574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] PATH_INFO: `/v3/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:21.725481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] RBAC: Authorizing `identity:get_role(role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:21.726915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:21.729277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 551/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:21 2022] GET /identity/v3/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 223 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:21.740412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86354f-539c-42a7-aa5f-99088778689b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:21.914173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86354f-539c-42a7-aa5f-99088778689b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:21.975848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:21.976470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:21.976980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:21.977396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] PATH_INFO: `/v3/users/dfe29d1beaac424db5da94f09a894ea5` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:22.005169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe29d1beaac424db5da94f09a894ea5)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:22.010491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:22.012953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 563/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:21 2022] GET /identity/v3/users/dfe29d1beaac424db5da94f09a894ea5 => generated 286 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:22.022284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:22.039267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:22.182448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fcdf4-3ca5-41da-b081-f93a6660fa9f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:22.245066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:22.245987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:22.246469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:22.246939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:22.341032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:22.342666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:22.354307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:22.524745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 552/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:22.535548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:22.564032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:22.737929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f391-92e5-4fb2-908c-f390ec637c50 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:22.809093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:22.810046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:22.810512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:22.810968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:22.814153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:22.816767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024c7a5-2d89-4f27-9ba8-81b6dd1028a9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:22.820006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 564/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:22 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:22.831585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:23.027666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71e70c-c350-435f-8c7b-ea2b4cf61dd1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:23.042501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:23.094706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:23.095620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:23.096094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:23.096558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:23.098046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb, user.id=dfe29d1beaac424db5da94f09a894ea5) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:23.098539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:23.101307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df94a3-ef17-4a9b-8943-41bf818bd77f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:23.112847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 553/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:22 2022] GET /identity/v3/role_assignments?user.id=dfe29d1beaac424db5da94f09a894ea5&scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:26.644429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470a72-b612-47d3-b38f-1f0d474c3012 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:26.645525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470a72-b612-47d3-b38f-1f0d474c3012 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:26.645525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac470a72-b612-47d3-b38f-1f0d474c3012 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:26.648006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 565/1118] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:26.655012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:26.656329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:26.656329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:26.689944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:26.692006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:26.835222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 554/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:27.159495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470a72-b612-47d3-b38f-1f0d474c3012 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:27.335135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:27.373012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac470a72-b612-47d3-b38f-1f0d474c3012 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:27.447535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:27.448668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:27.449213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:27.449723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] PATH_INFO: `/v3/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:27.452557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] RBAC: Authorizing `identity:get_role(role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:27.456011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:27.458829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 566/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:27 2022] GET /identity/v3/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 223 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:27.469900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:27.639525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:27.645248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a120-d30f-4e42-8123-35fc9d62c796 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:27.701044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:27.705187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:27.705575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:27.705948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] PATH_INFO: `/v3/users/dfe29d1beaac424db5da94f09a894ea5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:27.707384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe29d1beaac424db5da94f09a894ea5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:27.708990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:27.710673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 555/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:27 2022] GET /identity/v3/users/dfe29d1beaac424db5da94f09a894ea5 => generated 286 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:27.717635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:27.928710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052ff3-bd4e-4c2b-b470-0c72a3675dd4 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:27.998642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:28.000121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.000575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.001083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.003137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:28.005798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec8d3-19ee-496f-b137-c3b77296247f None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:28.008738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 567/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:27 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:28.017856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:28.229095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d3380-4de2-49ef-b7f0-4fe326172c11 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:28.297544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:28.298722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.299211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.299675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb/users/dfe29d1beaac424db5da94f09a894ea5/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.303779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b2ea89ac2ef489581549d9a5bc64ffb, user_id=dfe29d1beaac424db5da94f09a894ea5, role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:28.306596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80dbc7d-6668-4a41-8989-8bf212015a24 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:28.331524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 556/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:10:28 2022] PUT /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb/users/dfe29d1beaac424db5da94f09a894ea5/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:10:30.434407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dec2a-cb61-42f0-93e8-0740c28cf5bf None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:30.434985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dec2a-cb61-42f0-93e8-0740c28cf5bf None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:30.435309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dec2a-cb61-42f0-93e8-0740c28cf5bf None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:30.437883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 568/1124] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:30.443990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:30.444840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:30.445027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:30.465669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:30.467025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:30.497907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:30.585068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 557/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:31.096327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dec2a-cb61-42f0-93e8-0740c28cf5bf None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:31.132450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:31.297757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dec2a-cb61-42f0-93e8-0740c28cf5bf None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:31.368063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:31.368969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:31.369415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:31.369843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] PATH_INFO: `/v3/roles/749bb37b31c24adb85b8874c7f9328f1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:31.372438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] RBAC: Authorizing `identity:get_role(role_id=749bb37b31c24adb85b8874c7f9328f1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:31.375632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:31.378000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 569/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:31 2022] GET /identity/v3/roles/749bb37b31c24adb85b8874c7f9328f1 => generated 223 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:31.387181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:31.595986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5535b6-ffd2-45af-a172-20dc1c504ae5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:31.662500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:31.663487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:31.663951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:31.664411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] PATH_INFO: `/v3/users/dfe29d1beaac424db5da94f09a894ea5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:31.666592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe29d1beaac424db5da94f09a894ea5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:31.669508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:31.672742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 558/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:31 2022] GET /identity/v3/users/dfe29d1beaac424db5da94f09a894ea5 => generated 286 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:31.682809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:31.852507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:31.882418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e8dd8-1897-4586-907b-8542b6dd5038 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:31.949014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:31.949924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:31.950381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:31.950866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:32.082350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:32.085217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:32.251776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:32.283557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 570/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:32.293717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:32.347575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:32.477374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662aff7-d9ba-4ce7-bac9-94c066158443 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:32.537799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:32.538449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:32.538723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:32.538992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] PATH_INFO: `/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:32.540210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] RBAC: Authorizing `identity:get_project(project_id=9b2ea89ac2ef489581549d9a5bc64ffb)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:32.542141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf8247-b11b-40be-b152-aafc70349d23 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:32.544240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 559/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:32 2022] GET /identity/v3/projects/9b2ea89ac2ef489581549d9a5bc64ffb => generated 311 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:32.553387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:32.677401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdccd-5a38-4c48-a644-d82f881eaecf None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:32.716871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:32.718550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:32.718801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:32.719184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:32.720138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] RBAC: Adding query filter params (role.id=749bb37b31c24adb85b8874c7f9328f1, scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb, user.id=dfe29d1beaac424db5da94f09a894ea5) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:32.720540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:32.722167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660886b5-d72e-4b4b-b59d-b4252014de4b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:32.729492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 571/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:32 2022] GET /identity/v3/role_assignments?user.id=dfe29d1beaac424db5da94f09a894ea5&scope.project.id=9b2ea89ac2ef489581549d9a5bc64ffb&role.id=749bb37b31c24adb85b8874c7f9328f1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:35.538315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9e2d-9975-46ed-838f-ab310fb095f5 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:35.539166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9e2d-9975-46ed-838f-ab310fb095f5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:35.539166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9e2d-9975-46ed-838f-ab310fb095f5 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:35.540337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 560/1131] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:35.548530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:35.549135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:35.549518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:35.581004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:35.583020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:35.668376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:35.705945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 572/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:35.990008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b9e2d-9975-46ed-838f-ab310fb095f5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:36.173831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:36.189870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b9e2d-9975-46ed-838f-ab310fb095f5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:36.255023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:36.256056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:36.256551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:36.257081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:36.259229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:36.262054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532b0b0-cc63-4a3c-864a-0d666420652c None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:36.266574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 561/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:36.276450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:36.408076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2b746-cbe5-4705-b8c9-afc9c07b9601 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:36.465253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:36.466308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:36.466802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:36.467289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:36.469257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:36.472258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30802702-9084-4bd6-9665-bd2d8bdcf0ef None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:36.524476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 573/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:10:36 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:38.981007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357fb4-425f-4e5f-9055-e73bcb977eb3 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:38.981897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357fb4-425f-4e5f-9055-e73bcb977eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:38.981897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84357fb4-425f-4e5f-9055-e73bcb977eb3 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:38.983096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 562/1135] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:38.990222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:38.991054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:38.991054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:39.011306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:39.012591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:39.045602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:39.102404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 574/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:39.379229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84357fb4-425f-4e5f-9055-e73bcb977eb3 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:39.526830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84357fb4-425f-4e5f-9055-e73bcb977eb3 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:39.596260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:39.597379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:39.597859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:39.598349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:39.600394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:39.603169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba9fcb-8ec1-4eed-9c46-35a3d0534143 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:39.606341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 563/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:39.617274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:39.819088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbf4c9-e677-4c84-9f20-c6f5fab46809 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:39.892066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:39.893174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:39.893685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:39.894162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:39.895389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:39.898249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd2202-863b-4a1c-95fb-b438befa1dc8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:39.931621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 575/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:10:39 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:42.924592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdca8-77df-4a08-a400-b26e9fcfb844 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:42.925300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdca8-77df-4a08-a400-b26e9fcfb844 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:42.925450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bdca8-77df-4a08-a400-b26e9fcfb844 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:42.927720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 564/1139] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:42.938423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:42.939098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:42.939379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:42.966451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:42.968587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:42.997138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:43.098219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 576/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:43.629301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bdca8-77df-4a08-a400-b26e9fcfb844 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:43.689155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:43.819259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bdca8-77df-4a08-a400-b26e9fcfb844 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:43.888624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:43.890337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:43.890833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:43.891292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:43.911594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:43.920613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:43.922754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:43.924491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 565/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:43.931638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:44.068165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9f48f-2f05-48a1-b14c-47479e4a0e16 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:44.132592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:44.133727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:44.134211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:44.134696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:44.135973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:44.136510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:44.139270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:44.157390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 577/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:44.167215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:44.335998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:44.348431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d2af7-aef0-40d6-a922-5ab3b7a52433 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:44.388094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:44.388905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:44.389273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:44.390178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] PATH_INFO: `/v3/users/39f6aa4eeac748df967af195d0e11930` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:44.410363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=39f6aa4eeac748df967af195d0e11930)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:44.412064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:44.414069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 566/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:44 2022] GET /identity/v3/users/39f6aa4eeac748df967af195d0e11930 => generated 286 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:44.421448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:44.443984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:44.600011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eb384-d1f5-4f51-8e7a-0fe0da744288 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:44.642736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:44.643537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:44.643939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:44.644306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:44.727928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:44.729627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:44.743901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:44.851088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 578/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:44.860868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:45.003324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc37d7-1b97-40ed-8a81-0d4319302ed4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:45.068282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:45.069493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:45.069990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:45.070482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] PATH_INFO: `/v3/projects/db7c68448e014208aebc47c3851a8f79` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:45.072602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] RBAC: Authorizing `identity:get_project(project_id=db7c68448e014208aebc47c3851a8f79)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:45.075532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82364453-dc1f-4f70-a756-1562ff2272e0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:45.079661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 567/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:44 2022] GET /identity/v3/projects/db7c68448e014208aebc47c3851a8f79 => generated 311 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:45.089904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:45.284312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a408a-b100-4118-9716-bfc536c53c6a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:45.305593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:45.348672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:45.349692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:45.350139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:45.350580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:45.351849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=db7c68448e014208aebc47c3851a8f79, user.id=39f6aa4eeac748df967af195d0e11930) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:45.352380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:45.354943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a72955-e67e-4460-a793-9927bb4ea27c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:45.365067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 579/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:45 2022] GET /identity/v3/role_assignments?user.id=39f6aa4eeac748df967af195d0e11930&scope.project.id=db7c68448e014208aebc47c3851a8f79&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:47.976372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd13f-3081-4f23-8a08-a457b6253d79 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:47.977023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd13f-3081-4f23-8a08-a457b6253d79 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:47.977363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffdd13f-3081-4f23-8a08-a457b6253d79 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:47.979866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 568/1147] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:47.989381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:47.990180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:47.990180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:48.010867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:48.012270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:48.125677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 580/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:48.406828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd13f-3081-4f23-8a08-a457b6253d79 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:48.429660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:48.525995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffdd13f-3081-4f23-8a08-a457b6253d79 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:48.575510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:48.576611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:48.577254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:48.577485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:48.597991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:48.607249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:48.609620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:48.614125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 569/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:48.616908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:48.741425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b00e2-6496-42ea-9443-66b7b854a854 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:48.744094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:48.805878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:48.813117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:48.829957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 581/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:48.836927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:48.981178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:49.028725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dfd1c-9b1f-4be9-8bbf-a039f2548b1e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:49.096148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:49.097275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:49.097763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:49.098244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] PATH_INFO: `/v3/users/39f6aa4eeac748df967af195d0e11930` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:49.100411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] RBAC: Authorizing `identity:get_user(user_id=39f6aa4eeac748df967af195d0e11930)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:49.103195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:49.106331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 570/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:48 2022] GET /identity/v3/users/39f6aa4eeac748df967af195d0e11930 => generated 286 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:49.113959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:49.262680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f7b7-b8f7-40d6-a74a-0be2f7ca3752 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:49.306022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:49.306636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:49.306965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:49.307308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] PATH_INFO: `/v3/projects/db7c68448e014208aebc47c3851a8f79` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:49.308599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] RBAC: Authorizing `identity:get_project(project_id=db7c68448e014208aebc47c3851a8f79)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:49.310205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bcff5-b3f8-4ddb-b6cc-fcb4599cac06 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:49.313032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 582/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:49 2022] GET /identity/v3/projects/db7c68448e014208aebc47c3851a8f79 => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:49.320245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:49.471801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02e812-61f5-44b3-af2a-1644fa31686e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:49.511282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:49.512052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:49.512373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:49.512685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] PATH_INFO: `/v3/projects/db7c68448e014208aebc47c3851a8f79/users/39f6aa4eeac748df967af195d0e11930/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:49.515417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] RBAC: Authorizing `identity:create_grant(project_id=db7c68448e014208aebc47c3851a8f79, user_id=39f6aa4eeac748df967af195d0e11930, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:49.516968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b987097-68dd-4200-815e-d1c909bebe68 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:49.539033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 571/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:10:49 2022] PUT /identity/v3/projects/db7c68448e014208aebc47c3851a8f79/users/39f6aa4eeac748df967af195d0e11930/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:10:52.101506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3be2b-9b6d-4c28-af13-547e6037d7d9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:52.102275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3be2b-9b6d-4c28-af13-547e6037d7d9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:52.102408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3be2b-9b6d-4c28-af13-547e6037d7d9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:52.104823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 583/1154] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:52.113512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:52.114374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:52.114374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:52.122133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:52.136543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:52.138451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:52.227093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 572/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:52.514124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3be2b-9b6d-4c28-af13-547e6037d7d9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:52.560541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:52.656052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3be2b-9b6d-4c28-af13-547e6037d7d9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:52.706667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:52.707594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:52.708015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:52.708444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:52.728711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:52.738872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:52.740119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:10:52.741307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 584/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:52.750633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:52.870614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4074a-3a02-4d3b-85e8-98ad45bf15da None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:52.924760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:52.925424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:52.925701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:52.925976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:52.926679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:52.927013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:52.928429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:52.930273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:52.942605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 573/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:52.953458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:53.086512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:53.099951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8002ed-13fc-4a91-b3f9-57720b158cac None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:53.160949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:53.161998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:53.162477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:53.162955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] PATH_INFO: `/v3/users/39f6aa4eeac748df967af195d0e11930` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:53.164998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] RBAC: Authorizing `identity:get_user(user_id=39f6aa4eeac748df967af195d0e11930)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:53.167716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:53.171456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 585/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:10:52 2022] GET /identity/v3/users/39f6aa4eeac748df967af195d0e11930 => generated 286 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:53.180732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:53.313432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06824028-1696-4083-88b2-9ba064ebb4b6 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:53.353972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:53.354837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:53.355278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:53.355626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:53.445860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:53.454363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:53.455901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:53.570644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 574/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:10:53.578144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:53.708798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d701e9-4cd0-4d33-9e01-d580b53075e2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:53.773955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:53.774961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:53.775421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:53.775885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] PATH_INFO: `/v3/projects/db7c68448e014208aebc47c3851a8f79` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:53.777760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] RBAC: Authorizing `identity:get_project(project_id=db7c68448e014208aebc47c3851a8f79)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:53.781072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0635-94ba-4db2-8b4a-5c32db1c3e65 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:53.784110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 586/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:10:53 2022] GET /identity/v3/projects/db7c68448e014208aebc47c3851a8f79 => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:53.794410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:53.975932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:53.987397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d0020-72d0-4517-9545-cb01765555cb None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:54.051453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:54.052508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:54.053049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:54.053546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:54.054938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=db7c68448e014208aebc47c3851a8f79, user.id=39f6aa4eeac748df967af195d0e11930) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:54.055495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:54.058264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a753384-8870-4858-8081-38ca61188f88 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:54.070060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 575/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:53 2022] GET /identity/v3/role_assignments?user.id=39f6aa4eeac748df967af195d0e11930&scope.project.id=db7c68448e014208aebc47c3851a8f79&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:56.426831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970309-20cc-489d-8d61-a690fa6e0983 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:56.427378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970309-20cc-489d-8d61-a690fa6e0983 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:56.427484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970309-20cc-489d-8d61-a690fa6e0983 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:56.428983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 587/1162] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:10:56.435148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:56.435722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:56.435722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:56.463482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:56.465601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:56.588248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 576/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:10:56.976969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970309-20cc-489d-8d61-a690fa6e0983 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:57.036698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:57.168327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970309-20cc-489d-8d61-a690fa6e0983 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:57.230544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:57.231476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:57.231923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:57.232393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:57.335572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:57.337125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:57.374900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:57.485962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 588/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:57.492765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:57.626125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:57.644360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687624e-d471-42e1-aca0-5a93b7f367b4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:57.703559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:57.704669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:57.705213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:57.705710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:57.719046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:57.721901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-fd0d077e-c311-4d68-8fdb-682f3013ca75 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:57.744471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:57.746038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:10:57.747122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 577/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:10:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:57.756378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:57.881443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056fcea-718a-42d1-8bd8-9da2d25310e3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:57.925748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:57.937544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:57.938608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:57.939115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:57.939621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:57.940932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:57.941493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:57.944208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829804e-5728-4ad5-8416-9ffc5aa8284d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:57.958541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 589/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Tue Aug 23 22:10:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:00.053594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9ffb-ca84-422f-8f48-33a46788f193 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:00.054485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9ffb-ca84-422f-8f48-33a46788f193 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:00.054485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff9ffb-ca84-422f-8f48-33a46788f193 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:00.056172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 578/1167] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:11:00.064088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042cc-659b-414f-8b9e-ff321d863ab6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:00.064944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042cc-659b-414f-8b9e-ff321d863ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:00.065129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71042cc-659b-414f-8b9e-ff321d863ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:00.097297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f71042cc-659b-414f-8b9e-ff321d863ab6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:00.099376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f71042cc-659b-414f-8b9e-ff321d863ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:00.219068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 590/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:11:00.745309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9ffb-ca84-422f-8f48-33a46788f193 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:00.946274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff9ffb-ca84-422f-8f48-33a46788f193 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:00.996940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:00.997628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:00.997999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:00.998369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:00.999791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:01.001401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3dd2a-52f5-40ea-9e78-25fabfebefe2 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:01.022943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 579/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Tue Aug 23 22:11:00 2022] POST /identity/v3/domains => generated 267 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:04.136362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a3ed-7e77-4f90-be4d-174add691003 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:04.137227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a3ed-7e77-4f90-be4d-174add691003 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:04.137437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8a3ed-7e77-4f90-be4d-174add691003 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:04.138824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 591/1170] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:04.145055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:04.145825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:04.146007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:04.167460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:04.168899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:04.173282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:04.254759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 580/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:11:04.692415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8a3ed-7e77-4f90-be4d-174add691003 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:04.865702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8a3ed-7e77-4f90-be4d-174add691003 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:04.898367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:04.912107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:04.912830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:04.913161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:04.913478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] PATH_INFO: `/v3/domains/4ea3bde7669a49e6b9e5b07decd04bab` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:04.926459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4ea3bde7669a49e6b9e5b07decd04bab)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:04.928077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0fc14d-4012-4281-b155-83f9c443e636 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:04.929959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 592/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Tue Aug 23 22:11:04 2022] GET /identity/v3/domains/4ea3bde7669a49e6b9e5b07decd04bab => generated 267 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:04.940627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:05.071384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5254268-c39e-4bcf-94e4-2784ff89b086 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:05.112560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:05.113384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:05.113755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:05.114113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:05.114859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:05.116480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ecbd6-9c74-48d9-96b7-bbe79716a432 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:05.130364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:05.152954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 581/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:11:04 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:11:07.498273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782285-a00a-4ede-b27b-4805384f300b None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:07.498866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782285-a00a-4ede-b27b-4805384f300b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:07.498983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30782285-a00a-4ede-b27b-4805384f300b None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:07.500329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 593/1174] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:07.507649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:07.508209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:07.508209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:07.528773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:07.530611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:07.653576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 582/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:11:07.937022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782285-a00a-4ede-b27b-4805384f300b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:08.124665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30782285-a00a-4ede-b27b-4805384f300b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:08.164217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:08.164923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:08.165325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:08.165683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] PATH_INFO: `/v3/domains/4ea3bde7669a49e6b9e5b07decd04bab` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:08.166927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4ea3bde7669a49e6b9e5b07decd04bab)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:08.168442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad06c1-5e97-4cdb-9773-4ed9ceaabdf0 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:08.170311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 594/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Tue Aug 23 22:11:07 2022] GET /identity/v3/domains/4ea3bde7669a49e6b9e5b07decd04bab => generated 267 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:08.176497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:08.295081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88714f-b47a-432d-8bc7-26579c475f9e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:08.323620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:08.339752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:08.340457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:08.340777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:08.341181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:08.341884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:08.343954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a930fa-7ebd-4241-9e51-c3062bc63c82 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:08.368322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 583/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:11:08 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:11:10.441885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a460-2193-4e99-8e31-0954484c6e2b None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:10.442489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a460-2193-4e99-8e31-0954484c6e2b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:10.442854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6a460-2193-4e99-8e31-0954484c6e2b None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:10.445432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 595/1178] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:10.452293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28662030-a770-40b1-9a5e-94438f570773 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:10.453186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28662030-a770-40b1-9a5e-94438f570773 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:10.453186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28662030-a770-40b1-9a5e-94438f570773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:10.475636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-28662030-a770-40b1-9a5e-94438f570773 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:10.476948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-28662030-a770-40b1-9a5e-94438f570773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:10.565969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 584/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:11:10.838678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6a460-2193-4e99-8e31-0954484c6e2b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:10.901372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:10.965980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6a460-2193-4e99-8e31-0954484c6e2b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:11.009589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:11.010412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.010868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.011263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.023967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:11.028616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:11.031265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:11:11.032920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 596/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:11:11.038726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28662030-a770-40b1-9a5e-94438f570773 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:11.168454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28662030-a770-40b1-9a5e-94438f570773 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:11.180635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:11.223689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:11.224743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.225273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.225757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.226791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:11.227338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:11.229979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:11.244629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 585/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:11.254855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:11.369826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d889d95-ca71-417b-8c06-747a2fda5986 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:11.389857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:11.420725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:11.422660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.423146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.424116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] PATH_INFO: `/v3/users/cfcd96c62448437fbe6c1f280a913ae7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.444112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cfcd96c62448437fbe6c1f280a913ae7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:11.446806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:11.449681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 597/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:11 2022] GET /identity/v3/users/cfcd96c62448437fbe6c1f280a913ae7 => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:11.462061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:11.649004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d65984-65eb-459b-824e-29746cc7d108 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:11.717544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:11.720337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:11.720869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:11.721349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:11.799552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:11.844200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:11.845945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:11.980274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 586/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:11:11.988490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.125462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3a60-dbcb-48a5-a1ac-30255446a8a3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.167066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.167710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.168031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.168252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] PATH_INFO: `/v3/projects/ecb35c8646db4c3889e7891bde16669b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.169471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] RBAC: Authorizing `identity:get_project(project_id=ecb35c8646db4c3889e7891bde16669b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.171505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895c1e-f882-454c-8910-408a672cab3c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.173263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 598/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:11 2022] GET /identity/v3/projects/ecb35c8646db4c3889e7891bde16669b => generated 361 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:12.180113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:12.286976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:12.329865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47040e1a-15c9-418e-b932-2b514539adc4 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:12.373932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:12.374612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:12.374926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:12.375324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:12.376106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=ecb35c8646db4c3889e7891bde16669b, user.id=cfcd96c62448437fbe6c1f280a913ae7) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:12.376415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:12.378073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194c583-b438-4cc2-bd0f-afbf839c5495 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:12.385067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 587/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:12 2022] GET /identity/v3/role_assignments?user.id=cfcd96c62448437fbe6c1f280a913ae7&scope.project.id=ecb35c8646db4c3889e7891bde16669b&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:14.431536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa77a-4f73-4b66-9ac3-04f13a633b45 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:14.432060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa77a-4f73-4b66-9ac3-04f13a633b45 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:14.432060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfa77a-4f73-4b66-9ac3-04f13a633b45 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:14.433411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 599/1186] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:14.439216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:14.439750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:14.439841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:14.460838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:14.462330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:14.544877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 588/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:11:14.823225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa77a-4f73-4b66-9ac3-04f13a633b45 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:14.870531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:14.980969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfa77a-4f73-4b66-9ac3-04f13a633b45 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:15.042458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:15.043504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:15.044001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:15.044474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:15.064288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:15.074002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:15.075268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:11:15.077162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 600/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:15.083502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:15.183597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:15.229041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de580-4209-41bf-8b6e-c93c6a918231 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:15.269045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:15.269809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:15.270176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:15.270539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:15.271335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:15.271723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:15.273355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:15.284233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 589/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:15.290698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:15.420576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:15.426059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c7be1-f7ae-48d4-930e-c82bdec947a2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:15.470435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:15.471135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:15.471342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:15.471613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] PATH_INFO: `/v3/users/cfcd96c62448437fbe6c1f280a913ae7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:15.472884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] RBAC: Authorizing `identity:get_user(user_id=cfcd96c62448437fbe6c1f280a913ae7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:15.474355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:15.476040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 601/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:15 2022] GET /identity/v3/users/cfcd96c62448437fbe6c1f280a913ae7 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:15.484587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:15.601687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a1943-70df-444b-9c43-fd19fd25d698 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:15.630873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:15.641279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:15.642089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:15.642450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:15.642820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] PATH_INFO: `/v3/projects/ecb35c8646db4c3889e7891bde16669b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:15.644053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] RBAC: Authorizing `identity:get_project(project_id=ecb35c8646db4c3889e7891bde16669b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:15.645573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0e569-a89e-4b3b-abd8-623cc38cc850 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:15.647521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 590/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:15 2022] GET /identity/v3/projects/ecb35c8646db4c3889e7891bde16669b => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:15.653791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:15.767126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576212-523b-4535-a713-9a7eea89c87b None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:15.810406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:15.811714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:15.812092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:15.812406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] PATH_INFO: `/v3/projects/ecb35c8646db4c3889e7891bde16669b/users/cfcd96c62448437fbe6c1f280a913ae7/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:15.814931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecb35c8646db4c3889e7891bde16669b, user_id=cfcd96c62448437fbe6c1f280a913ae7, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:15.816387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fab85-cdd6-40bb-b3b0-11592bc734d7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:15.831249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 602/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:11:15 2022] PUT /identity/v3/projects/ecb35c8646db4c3889e7891bde16669b/users/cfcd96c62448437fbe6c1f280a913ae7/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:11:17.904051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acef54-51a4-4aec-a690-f8ae442192f7 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.905235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acef54-51a4-4aec-a690-f8ae442192f7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.905598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acef54-51a4-4aec-a690-f8ae442192f7 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.908272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 591/1193] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:11:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:17.917276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:17.918133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:17.918334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:17.950143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:17.952234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:17.991139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.053578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 603/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:11:18.340135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acef54-51a4-4aec-a690-f8ae442192f7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.494232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acef54-51a4-4aec-a690-f8ae442192f7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.541909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.542679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.543137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.543460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.557726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:11:18.564236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:11:18.566176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:11:18.567798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 592/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:11:18.573223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.749895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450efe4d-7ef4-42ee-88f2-ce809de9e285 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:18.813562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:18.814580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:18.815074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:18.815532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:18.816698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:18.817264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:18.819831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:18.835905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 604/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:18.842125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:18.914421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:18.974336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebb6c9-abc7-427d-ad16-9110d0a2fd78 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.018993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.019636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.019917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.020193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] PATH_INFO: `/v3/users/cfcd96c62448437fbe6c1f280a913ae7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.021401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] RBAC: Authorizing `identity:get_user(user_id=cfcd96c62448437fbe6c1f280a913ae7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.022851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.024475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 593/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Tue Aug 23 22:11:18 2022] GET /identity/v3/users/cfcd96c62448437fbe6c1f280a913ae7 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:11:19.031367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.051964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.157433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04adb01-2fe0-418c-a17b-c32791a559ee None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.209479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.210463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.210777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.211062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.303021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.304384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.329080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.430764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 605/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:11:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:11:19.437869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.550047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b46ce-4d1d-4d76-b502-1fb5ad01a747 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.573016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.588077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.588739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.589053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.589327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] PATH_INFO: `/v3/projects/ecb35c8646db4c3889e7891bde16669b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.590711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] RBAC: Authorizing `identity:get_project(project_id=ecb35c8646db4c3889e7891bde16669b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.593507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7fcda-61b8-44d7-8ebd-9d3dff6e2d25 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.595218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 594/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Tue Aug 23 22:11:19 2022] GET /identity/v3/projects/ecb35c8646db4c3889e7891bde16669b => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:19.601545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:19.700319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ae50-e61e-4e08-9be4-b58bc6e37a76 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:19.721385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:19.741676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:19.742313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:19.742595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:19.742868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:19.743623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=ecb35c8646db4c3889e7891bde16669b, user.id=cfcd96c62448437fbe6c1f280a913ae7) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:11:19.743936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:19.745470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeac1a8-c8cd-493c-835c-1da990860ea7 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:19.752711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 606/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:11:19 2022] GET /identity/v3/role_assignments?user.id=cfcd96c62448437fbe6c1f280a913ae7&scope.project.id=ecb35c8646db4c3889e7891bde16669b&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:11:29.583583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:29.749456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=9 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:24.407254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c964f-b718-46ef-8587-107b6c79d398 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.407254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c964f-b718-46ef-8587-107b6c79d398 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.407254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c964f-b718-46ef-8587-107b6c79d398 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.407254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 595/1201] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:24.417202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.417202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.418164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.458049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:24.461213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:24.634295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 607/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:24.997876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c964f-b718-46ef-8587-107b6c79d398 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.189301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c964f-b718-46ef-8587-107b6c79d398 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.264598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.265804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.266228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.266712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.294583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.297404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:25.330902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:25.333006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:25.334096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:25.334096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:25.334096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:25.334096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 596/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:25.346102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.564693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ce6e2-457c-426c-9d4a-e45445dedad8 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.625602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.636781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.639515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.640075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.640561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.641833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:25.642367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.645023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925fa3a-7e8c-4582-8725-d5a382556330 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:25.672450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 608/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:25.681606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.787142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.893255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875ec0f-c6bd-42af-8203-febd70737374 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.963922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.964609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.964928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.965297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.966551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.968346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ff155-2a0e-4c89-a49d-8033f2858da1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:26.003990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 597/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Tue Aug 23 22:12:25 2022] POST /identity/v3/users => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:12:28.964412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d0d8-29d8-4ea6-a877-f2b4aaf0bfbc None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.964412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d0d8-29d8-4ea6-a877-f2b4aaf0bfbc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.964412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d0d8-29d8-4ea6-a877-f2b4aaf0bfbc None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.964412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 609/1206] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:28.971922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.972751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.972751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.004799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:29.007746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:29.147182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 598/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:29.462135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205d0d8-29d8-4ea6-a877-f2b4aaf0bfbc None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.656901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205d0d8-29d8-4ea6-a877-f2b4aaf0bfbc None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:29.714398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:29.715382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:29.715944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:29.716969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:29.741444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:29.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:29.753540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:29.754593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:29.755312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 610/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:29.763475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:29.851762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:29.995156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a8a8a-522e-43fb-a0a2-87c0e973d3a0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.063647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.068857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.083131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 599/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:30.093371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.188605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.287578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adc27-f7a3-46e2-a3c9-43e71465f622 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.366348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.367571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.368037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.368671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.396260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.397076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:30.428244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:30.433015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:30.434989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:30.434989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:30.434989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:30.434989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 611/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:30.442106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:30.682222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:30.689600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a918787-b32c-4813-9e87-a264b4f43233 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:30.779672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:30.780709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.781241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.781712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.782936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:30.783507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:30.786102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:30.810009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 600/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:30.820764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.066326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace76268-f2ab-4c7c-8698-0a55a57a4e68 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.069458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:31.155058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.156125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.156542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.157068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.175740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.177348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:31.192749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:31.195475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:31.197761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 612/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:31.201212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.380630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd0c18-c713-4f14-9771-04034c47ad4a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.448095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.448948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.449144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.449308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.450806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:31.451120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.454083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:31.490880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 601/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:12:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:31.500676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.684044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f368e-3822-4cda-bf73-d1bd78332d29 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.744090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.745090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.745450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.745820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.805699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:31.894218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.897020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.116928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 613/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:12:32.118432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.151830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.326756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f59c02-2fec-4d0b-ad37-00e24d846677 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.416768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.418301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.418748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.419884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.435575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.437522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:32.456497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:32.458421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:32.467462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:32.467462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:32.467462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:32.467462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 602/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:32.472124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.601370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.685743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c567c38-db03-44d0-bf02-ddbbc2301a2c None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.740798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.742085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.742645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.743177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.744717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:32.745486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:32.749665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:32.768562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 614/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:32.778382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:32.885031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:32.935162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df4079-979e-4276-8127-e43c527e50f7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:32.988864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:32.989449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:32.989725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:32.990022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:32.999532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.001222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:33.018622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:33.020697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:33.022067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 603/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:33.028091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.191544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa978eb-8acd-4992-a2ca-28901bcad04e None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.224697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.249932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.250928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.251466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.251946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.253375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:33.253979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.256827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8ab40-0e33-4248-9ecf-1b5c20f4d3be None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.290208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 615/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:33.294493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:33.496483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a813b-eb01-4e0d-8648-741ff8835291 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:33.557787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:33.575155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:33.577148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.577636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.578360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.579832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=be96e2c5285540cca2ecc4e73a75cd0a) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:33.580417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:33.583216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4ff11-78d0-4ce3-b426-c8c5bce7c663 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:33.595913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 604/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:33 2022] GET /identity/v3/role_assignments?user.id=be96e2c5285540cca2ecc4e73a75cd0a&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:36.084309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb1fc-c69b-4ee0-8d6c-98beb7cd32fc None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.085269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb1fc-c69b-4ee0-8d6c-98beb7cd32fc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.085446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfb1fc-c69b-4ee0-8d6c-98beb7cd32fc None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.087795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 616/1220] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:36.098841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.099717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.099876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.134210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.136507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.255163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 605/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:36.761866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb1fc-c69b-4ee0-8d6c-98beb7cd32fc None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.944420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfb1fc-c69b-4ee0-8d6c-98beb7cd32fc None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.003930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.004915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.005327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.005806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.020824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:37.026032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.028050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:37.030141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 617/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.038946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.241028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b62a8-751a-42c3-8360-7cafa53b3732 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.281689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.297574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.298444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.299027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.299405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.300497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] RBAC: Adding query filter params (name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.301040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.302787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.313834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 606/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:37.320928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.396422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:37.485469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338a66f-ca3f-431c-98d5-6b83d6cd5278 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.548512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.549566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.549979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.550520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.569485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.571371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:37.597792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:37.599195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:37.600224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:37.600224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:37.600224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:37.600224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 618/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:37.610779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:37.819175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697aa21-b318-4afc-a7c5-88cebc22f498 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:37.885736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:37.887009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:37.888296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:37.888938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:37.890223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:37.891022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:37.895047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:37.933482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 607/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:37.937055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.140876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.156703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398cfc8-09d2-4dc6-8749-c910cc982981 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.239102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.240298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.240855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.241319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.259468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.262164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:38.284498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.286309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:38.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 619/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:38.297366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.396584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:38.507616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf9966-fc5c-4de0-a870-45ea07f428b1 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.575374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.576570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.577214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.577642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.579410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:38.579672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.583864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.604690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 608/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:38.613026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:38.780620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4ecdf-ddef-44a4-ab5d-08788111a5a8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:38.845018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:38.846113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:38.846625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:38.847108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:38.869052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:38.871779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:38.902251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:38.905376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:38.906727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:38.906727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:38.906727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:38.906727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 620/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:38.915528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.120871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bece95-93a5-4702-a13f-16f99b0dcb36 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.126664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.186745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca93b-645a-4353-b288-653605623e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.187448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca93b-645a-4353-b288-653605623e71 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.187829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca93b-645a-4353-b288-653605623e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.188221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ca93b-645a-4353-b288-653605623e71 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.189079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca93b-645a-4353-b288-653605623e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.189505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca93b-645a-4353-b288-653605623e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.191158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ca93b-645a-4353-b288-653605623e71 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.213225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 609/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.215562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.229504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:39.405036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad35d15-66f8-40cd-9ba0-97e7f2058e23 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.483164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.484339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.484966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.485499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.500790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.503636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:39.526081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:39.527467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:39.528652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 621/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:39.538180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca93b-645a-4353-b288-653605623e71 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.782093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ca93b-645a-4353-b288-653605623e71 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.845166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.846004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.846536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.846952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.847947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:39.848388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.850315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193b7a7-bbfc-450d-9db0-99f7044e6694 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.865480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 610/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:39.873070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.977364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:40.035877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7950c-2610-4c0e-8a69-b077af3b6a69 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:40.094127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:40.094988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:40.095333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:40.095639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/be96e2c5285540cca2ecc4e73a75cd0a/roles/dce8b9fd8b2243f293ecb38505066017` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:40.122947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=be96e2c5285540cca2ecc4e73a75cd0a, role_id=dce8b9fd8b2243f293ecb38505066017)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:40.124444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5f816-f88e-477a-ae2a-7af935249197 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:40.145026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 622/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:39 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/be96e2c5285540cca2ecc4e73a75cd0a/roles/dce8b9fd8b2243f293ecb38505066017 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:12:43.048748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bbd55-9455-4113-b936-7e27c163570a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.049786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bbd55-9455-4113-b936-7e27c163570a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.049786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bbd55-9455-4113-b936-7e27c163570a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.052345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 611/1233] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:43.063145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:43.063853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:43.064432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:43.097362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:43.099441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:43.224981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 623/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:43.754073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bbd55-9455-4113-b936-7e27c163570a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:43.806014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:43.964000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bbd55-9455-4113-b936-7e27c163570a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.031120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.031904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.032263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.032704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.053646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:44.066425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:44.068458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:44.070105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 612/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Tue Aug 23 22:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:44.080715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:44.185511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.300876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496c31b-63bd-4463-bf51-d3102b777aa5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.365513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.366298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.366661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.367076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.367846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:44.368232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:44.369861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:44.380673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 624/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:44.389586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:44.568102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.617208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f14-2dbf-4d9f-813b-3402d41c403a None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.694066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.695162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.695812 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.696354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.719898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:44.721555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:44.745404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:44.748859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:44.750633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:44.750633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:44.750633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:44.750633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 613/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:44.757960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:44.937394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24c6d-fa46-4c1e-af45-cae76d9f0ea3 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:44.949931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:44.989772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:44.990841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.991308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.991791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.992792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:44.993297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:44.995429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.012105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 625/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:45.021982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.209962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdcbd6-d234-47ba-966f-d18507a68253 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.251571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.252196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.252471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.252744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.256387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.264134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.266361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:45.282612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:45.284904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:45.287346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 614/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:45.294065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.478212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567faccc-ec2e-41fd-ba59-e4b92f3510b9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.537040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.537675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.537957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.538234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.538983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:45.539299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.540781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.573997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 626/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:45.581868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.756571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cb4e7-cb32-42c3-b818-93af37d59dc8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.815026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.815859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.816251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.816635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.922636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:45.935006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.937623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.088578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 615/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:12:46.096678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.142312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.259086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fdc9b-2f06-42cf-af14-a2b6f8b8a27d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.321483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.322530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.322739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.322977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.337721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.339697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:46.362281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.364246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:46.366299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:46.366299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:46.366299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:46.366299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 627/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:46.373501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.534782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.546121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e27196-58d4-44db-937a-50b3d747e0bd None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.606719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.608132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.608902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.609298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.610407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:46.610801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.612464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.632132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 616/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:46.642575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:46.767812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:46.800850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bde6e3-8481-4737-a9d1-337413a12270 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:46.857594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:46.858387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:46.858710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:46.859154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:46.868629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:46.870709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:46.885167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:46.886774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:46.888253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:46.892862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 628/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:46.894101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.082585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea62217-54fc-472e-9bba-9f4dd8fde53e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.140714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.141625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.142081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.142541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.143775 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.144300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.147149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932829-92a2-41b1-951f-b633e249ae3f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.176666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 617/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:47.178863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.355775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbee8ca-0744-4915-aa85-a01461c3a496 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.420785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.421403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.421714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.421955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.423396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] RBAC: Adding query filter params (role.id=dce8b9fd8b2243f293ecb38505066017, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=be96e2c5285540cca2ecc4e73a75cd0a) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:47.423396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.424491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bfcd7-2b1f-45f4-b04d-ee8d280f63c8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.435924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 629/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/role_assignments?user.id=be96e2c5285540cca2ecc4e73a75cd0a&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=dce8b9fd8b2243f293ecb38505066017 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:49.818971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aedaa-7d78-4076-b724-4ca540a08c85 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.819923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aedaa-7d78-4076-b724-4ca540a08c85 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.819923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50aedaa-7d78-4076-b724-4ca540a08c85 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.821957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 618/1247] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:49.830493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:49.831099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:49.831482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:49.842883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:49.864469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:49.866646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:49.976801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 630/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:50.306801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aedaa-7d78-4076-b724-4ca540a08c85 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.338288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.476542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50aedaa-7d78-4076-b724-4ca540a08c85 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.536917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.537760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.538158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.538542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.555466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:50.563420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:50.565505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:50.566942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 619/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:50.576187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.740286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6371-07c7-4263-a2a3-7e7e3e1f4db6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:50.783513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.788798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:50.789562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.790388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.790910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.791774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:50.792221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:50.794648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:50.804831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 631/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:50.816237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:50.958341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:50.999170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f765a1-650c-4370-a7ca-5e075e918e3f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.051978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.052663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.052999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.053449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.066062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.067649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:51.084165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:51.086164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:51.088289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:51.088289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:51.088289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:51.088289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 620/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:51.092565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.260985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70872af-42ee-4f12-b917-de99ed668a5d None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.301929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.302635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.303012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.303227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.303960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:51.304299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.305857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.330057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 632/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:12:51.331982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.495781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34248866-b49d-4488-9e91-cf238c78dab7 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.543695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.555424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.556265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.556639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.557048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.570083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.572418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:51.589520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:51.592579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:51.593764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 621/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:51.605482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.708376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.781708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174d407-be70-4478-96d1-05ed18fb6527 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.855204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.857909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.858440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.858929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.860482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:51.861067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.863890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.893110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 633/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:51.900958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.052221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e3f84-b1d4-4bda-839a-047778893b34 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.110664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.111410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.111632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.111943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.219013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.242901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.245029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.430530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 622/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:12:52.445550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.658256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0334a-0e1d-4c6c-be1a-952be0b8f067 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.677165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.707515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.708346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.708765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.709240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.729735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.733690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:52.767480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:52.768659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:52.769707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:52.769707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:52.769707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:52.769889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 634/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:52.779962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.962529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:52.989458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d1440-241c-4cce-957c-95a165fb3277 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.062289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.063251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.063510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.063887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.064853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.065287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.067357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.087741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 623/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:53.096345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.251490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52202962-9db5-4fc3-af5e-14490bc45db8 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.299840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.300742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.301229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.301641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.312704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.315099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:53.331247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:53.333234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:12:53.334890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 635/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:53.343561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.534401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62808c4d-0ddb-4469-868b-a5dae7a0bd9e None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.576010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.576859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.577228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.577398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.578363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.578813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.581115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f91dbc-7f8c-4845-a0b9-a2844ed0223d None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.603228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 624/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:53.612620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.660657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:53.808047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37624c3e-ac1c-4361-9098-340d75760fff None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.877080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.878137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.878641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.879143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.880563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=be96e2c5285540cca2ecc4e73a75cd0a) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:53.881156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.884050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9386-c434-4e5f-b20c-4d43ee43c6fa None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.895544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 636/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/role_assignments?user.id=be96e2c5285540cca2ecc4e73a75cd0a&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:56.049638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596cd9-7fc0-44f1-9fdd-2223ad788633 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.050432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596cd9-7fc0-44f1-9fdd-2223ad788633 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.050432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4596cd9-7fc0-44f1-9fdd-2223ad788633 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.051560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 625/1261] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:12:56.058579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.059150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.059455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.082745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:56.084070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:56.168282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 637/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:12:56.467824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596cd9-7fc0-44f1-9fdd-2223ad788633 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.480306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.604591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4596cd9-7fc0-44f1-9fdd-2223ad788633 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.666216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.667268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.667717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.668184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.688376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:12:56.698116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:56.699996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:56.702048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 626/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:56.708207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.744064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.900608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72fab5-d4b3-4778-8a58-99a1ffbb1abd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.964593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.966191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.966678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.967155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.968342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:56.968912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.971493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.987624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 638/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:56.994391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.123895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.177198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a7342-7bcd-44f1-a77a-97cbc2c1257b None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.245867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.247417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.247902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.248484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.270957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.273953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:57.306324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.308239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:57.310532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:57.310532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:57.310532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:57.310532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 627/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:57.319430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.438619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.475813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f8d0-d959-46e7-8e36-e97cf753a4cf None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.534861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.535817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.536241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.536659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.537718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:57.538188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.540457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.563043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 639/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:57.571065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:57.761195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f057a83-69be-4978-bfa1-f2011fdf80c8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:57.800299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:57.827140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:57.828093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:57.828432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:57.828741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:57.837999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:57.839552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:12:57.853258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:57.855565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:57.858031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 628/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:57.863429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.036851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa32c8e-38e1-4a04-a70b-54f4882f609a None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.082778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.083464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.083844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.084196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.085156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.085522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.087099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.098834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.119517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 640/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:12:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:58.126688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.259614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5321a92-3a51-4897-8176-179743076fc8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.316406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.317302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.317689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.318067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.332460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.334255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:12:58.351403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:58.353570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:12:58.355163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:12:58.355163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:12:58.355163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:58.355163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 629/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:12:58.363976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.590296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a65ac-9c42-4089-ba29-8341531f7d28 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.663527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.664155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.664435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.664710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.665415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:58.665721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.667130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.681295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 641/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:58.690396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.736975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:58.821161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e8eca-c50c-4d53-b2ff-f6059f3296a8 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:58.861425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:58.862037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:58.862361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:58.862669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:58.870592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:58.872582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:12:58.891741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:12:58.893774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:12:58.895872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 630/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:12:58.900578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:58.970840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.018995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148b45-1838-46e4-95db-ec594b5d3ed2 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.064592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.065278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.065555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.065823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.066533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:12:59.066842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.068288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ddbc2-acb9-45ee-8038-e602cc3bda3b None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.085429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 642/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:12:59.096228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:59.266885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:59.282639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef2797-6413-4ccd-a29d-79bfa2dc468f None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:59.346173 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:59.347301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:59.347793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:59.348277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] PATH_INFO: `/v3/projects/23b22943e2514c8e9505656dd923fb15/users/be96e2c5285540cca2ecc4e73a75cd0a/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:59.351813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] RBAC: Authorizing `identity:create_grant(project_id=23b22943e2514c8e9505656dd923fb15, user_id=be96e2c5285540cca2ecc4e73a75cd0a, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:59.354631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7352d3c-3506-4781-b4bc-373ba74175cb None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:59.374925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 631/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Tue Aug 23 22:12:59 2022] PUT /identity/v3/projects/23b22943e2514c8e9505656dd923fb15/users/be96e2c5285540cca2ecc4e73a75cd0a/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:13:01.415174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cb-a300-489c-af78-62caee8e20e0 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.415771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cb-a300-489c-af78-62caee8e20e0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.415771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cb-a300-489c-af78-62caee8e20e0 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.417139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 643/1274] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:01.426288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:01.427089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:01.427089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:01.458428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:01.460308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:01.550478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 632/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:01.853459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03586cb-a300-489c-af78-62caee8e20e0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:01.967529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03586cb-a300-489c-af78-62caee8e20e0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:01.986103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.003768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.004399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.004675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.004974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.016261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:13:02.020915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.022028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:02.022979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 644/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Tue Aug 23 22:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:02.028977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.116580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.136894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84150ad-a814-46dd-9fbb-3184bc9ed5d3 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.174237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.174861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.175143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.175415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.176091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.176395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.177802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.187703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 633/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:02.194357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.304219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97c931-49c7-42e2-9dcc-43d3cb2ea8cd None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.343220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.343862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.344137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.344406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.355212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.357253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:02.372876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.374226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:02.375432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:02.375432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:02.375432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:02.375432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 645/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:02.380031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.488716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008d59f-93a5-4a6a-bc64-74f2bb8573e0 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.523346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.523956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.524223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.524490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.525161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.525520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.526885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.539615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 634/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:02.546518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.587207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.670344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf7c07-9c7e-4e47-a047-9807f6578624 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.706367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.706999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.707272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.707542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.717571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.719235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:13:02.733361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:02.734441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:02.735484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 646/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:02.740842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:02.744848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:02.863836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f09d-fdb4-4145-8693-bed138f40d51 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:02.913793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:02.914422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:02.914702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:02.914974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:02.915728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:02.916037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:02.918261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:02.944721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 635/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:02.951621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.103772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.122415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a5186-3a4b-447f-b157-2d3b656b2c04 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.164740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.165454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.165784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.166104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.253612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.255056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.378893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.395028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 647/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Tue Aug 23 22:13:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:13:03.401543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.474625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:03.532454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c068e-48e5-425f-9bc9-a0ccc9c6a6ef None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.578708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f693f-2c71-4788-bf94-787012450989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.579810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f693f-2c71-4788-bf94-787012450989 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.580303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f693f-2c71-4788-bf94-787012450989 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.580850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f693f-2c71-4788-bf94-787012450989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.598840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f693f-2c71-4788-bf94-787012450989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.601040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f693f-2c71-4788-bf94-787012450989 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-346f693f-2c71-4788-bf94-787012450989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:13:03.628068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:03.629957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:13:03.631839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:13:03.631839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:13:03.631839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:13:03.631839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 636/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:03.640492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.770631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b9d9b-e06d-47b9-a204-2cb12abe2f61 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:03.832729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:03.833689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:03.834177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:03.834656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:03.835812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:03.836342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:03.838929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:03.860631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 648/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:03.869637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f693f-2c71-4788-bf94-787012450989 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:03.988252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f693f-2c71-4788-bf94-787012450989 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:04.009109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:04.041143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:04.041896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.042257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.042576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.055662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:04.057334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:13:04.071237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:04.073434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: ERROR keystone.server.flask.application Aug 23 22:13:04.075452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 637/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Tue Aug 23 22:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:04.082596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:04.149702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:04.212067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c377a0b-e718-4656-9bfa-46bd64516e72 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:04.252203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:04.252892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.253219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.253564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.254319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:04.254667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:04.256189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ffebc-217a-469f-a19d-340dea813741 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:04.271580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 649/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Tue Aug 23 22:13:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:04.281322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:04.409509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d059ed-5ec2-444f-8f74-4d0bfe4c8873 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:04.454131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:04.455895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:04.455895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:04.455895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:04.457243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] RBAC: Adding query filter params (role.id=8947f3d800e34ad9be6765de1b8613a0, scope.project.id=23b22943e2514c8e9505656dd923fb15, user.id=be96e2c5285540cca2ecc4e73a75cd0a) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:04.457770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:04.460319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5069fbc-024a-498b-820a-acf49e011baa None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:04.468847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 638/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Tue Aug 23 22:13:04 2022] GET /identity/v3/role_assignments?user.id=be96e2c5285540cca2ecc4e73a75cd0a&scope.project.id=23b22943e2514c8e9505656dd923fb15&role.id=8947f3d800e34ad9be6765de1b8613a0 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:06.589977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50932e2-4ad6-4fc9-a134-98e8516e452e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.591643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50932e2-4ad6-4fc9-a134-98e8516e452e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.591643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50932e2-4ad6-4fc9-a134-98e8516e452e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.593703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 650/1288] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:13:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:06.601705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:06.602943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:06.602943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:06.628457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:06.629768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:06.670781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.719495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 639/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:06.993888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50932e2-4ad6-4fc9-a134-98e8516e452e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.181466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50932e2-4ad6-4fc9-a134-98e8516e452e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.197974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:07.231560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.232333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.232694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.233102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.233841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.235377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:07.246132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:07.248983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:07.250908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 651/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:13:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:07.256035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.381496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2a1a3-c4c1-45f0-aa99-1e98594d3195 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.429151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.429807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.430084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.430354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.431019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.431320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.432754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e78aa2-fa89-4c12-814c-6a13e0bfab4f None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.440685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 640/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:07.447225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:07.579461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8aa5c-72e5-4f9b-aae5-59c37bc96eb9 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:07.624575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:07.625584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:07.625584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:07.625854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] PATH_INFO: `/v3/services` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:07.626392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:07.626975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:07.628066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50e7a-309e-4ca3-a411-fbb2d89faba5 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:07.633455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 652/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 23 22:13:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:09.857224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f720d1-1474-49d4-8b0b-c780e5706c03 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.858060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f720d1-1474-49d4-8b0b-c780e5706c03 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.858060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f720d1-1474-49d4-8b0b-c780e5706c03 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.859786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 641/1293] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:09.867454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636a9f-dfb2-47c6-8548-03eeb52a3d90 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:09.868041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636a9f-dfb2-47c6-8548-03eeb52a3d90 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:09.868432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80636a9f-dfb2-47c6-8548-03eeb52a3d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:09.901251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-80636a9f-dfb2-47c6-8548-03eeb52a3d90 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:09.904006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-80636a9f-dfb2-47c6-8548-03eeb52a3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:09.941970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.006277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 653/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:10.457584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f720d1-1474-49d4-8b0b-c780e5706c03 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:10.491287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:10.581492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f720d1-1474-49d4-8b0b-c780e5706c03 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:10.629387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:10.630071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.630346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.630630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.631391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:10.632850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65b53b-ab6d-4b70-92e7-a0326dc7c6e7 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:10.654630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 642/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Tue Aug 23 22:13:10 2022] POST /identity/v3/services => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:12.644503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b072-d0ea-4c80-92a0-dba8f2ab664f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.645080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b072-d0ea-4c80-92a0-dba8f2ab664f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.645080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b072-d0ea-4c80-92a0-dba8f2ab664f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.646460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 654/1296] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:12.652206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.653359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.653359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.671845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:12.673003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:12.749329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 643/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:13.024904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b072-d0ea-4c80-92a0-dba8f2ab664f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.148965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b072-d0ea-4c80-92a0-dba8f2ab664f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.188835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.189502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.189779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.190051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.190641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.192025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:13.202559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:13.204891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:13.206653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 655/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:13:13.210256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.230734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.320768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b218da-d13b-4871-8899-9a3b81ad68c3 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.358625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.359245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.359523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.359794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.360436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.360739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.362149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.367777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 644/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:13:13.377070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.413885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.494062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467eb7e-d9a4-4e79-ab9a-237a17a07bfa None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.531758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.532389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.532669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.532984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.533700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] RBAC: Adding query filter params (interface=public, service_id=06c8de929c5249ccb694e36261d95d69, region_id=RegionOne) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:13.534010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.535400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c20e0-9a5a-4515-a026-adb5c596ec27 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.541188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 656/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/endpoints?service_id=06c8de929c5249ccb694e36261d95d69&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:13.550843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.647851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:13.681395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f3337-2b86-4bdc-8123-2c2d83095413 None admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.743600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.744637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.745152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.745626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.747614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.750492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c3ab6-2873-4a4e-bf38-dd6ca4fd2eab None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.765629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 645/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/services => generated 2191 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:13:15.783560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30f-7c2d-4de8-980d-edbba61c0e4e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.784423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30f-7c2d-4de8-980d-edbba61c0e4e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.784423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ba30f-7c2d-4de8-980d-edbba61c0e4e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.785696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 657/1302] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:15.792722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.794127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.794289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.825850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:15.828253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:15.939589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 646/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:13:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:13:16.217845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba30f-7c2d-4de8-980d-edbba61c0e4e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.336996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.345580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ba30f-7c2d-4de8-980d-edbba61c0e4e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.387620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.388405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.388768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.389175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.389863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.391366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:13:16.404114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:13:16.406278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application with Lock( Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: ERROR keystone.server.flask.application Aug 23 22:13:16.408010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 658/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:13:16.413833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.529191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:16.569245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c138161-a0e7-4478-b553-fabb5fa9df3e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.611526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.612200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.612521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.612870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] PATH_INFO: `/v3/services` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.613581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:13:16.613931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.615382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762c6675-8423-4bed-bd53-6f7b81e39c07 None admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.621741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 647/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Tue Aug 23 22:13:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:13:16.631686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:16.824451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9d4b9-5ce7-4b0a-9c5d-d8f0d439a625 None admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:16.895394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:16.896400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.896916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.897408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.898698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:16.901338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006aa4f-689d-4c1a-bc32-e5093770efc2 None admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.938161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 659/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:13:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:13:26.618522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=30 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:26.928479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:45.110651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f136-cd55-44c7-b582-cfd464f78194 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.111276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f136-cd55-44c7-b582-cfd464f78194 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.111626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01f136-cd55-44c7-b582-cfd464f78194 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.114501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 648/1307] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:14:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:45.124769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bcdc-2283-4c91-8275-8f4cdca58495 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.126199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bcdc-2283-4c91-8275-8f4cdca58495 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.127076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30bcdc-2283-4c91-8275-8f4cdca58495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.274072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-aa30bcdc-2283-4c91-8275-8f4cdca58495 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:45.275838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-aa30bcdc-2283-4c91-8275-8f4cdca58495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:45.429626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 660/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:45.761269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.762334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.763134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.766566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 649/1309] 10.222.0.69 () {54 vars in 965 bytes} [Tue Aug 23 22:14:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:45.773113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8550f4-1897-4d7a-b6f5-8e9f53dd8a05 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:45.773379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8550f4-1897-4d7a-b6f5-8e9f53dd8a05 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:45.773795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8550f4-1897-4d7a-b6f5-8e9f53dd8a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:45.878486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9a8550f4-1897-4d7a-b6f5-8e9f53dd8a05 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:45.879725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9a8550f4-1897-4d7a-b6f5-8e9f53dd8a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:45.907647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:45.993100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:45.995767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:46.006657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 661/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Tue Aug 23 22:14:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:14:46.184022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0a8ea-1101-419a-b8e2-7ad282515577 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:46.353249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:46.354906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:46.355385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:46.355867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:46.358274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:46.492905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:46.591410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:46.593300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b07f0-53ce-45df-b34f-99ccbf1358a8 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:46.623187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 650/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:14:48.946454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:48.946993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:48.946993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:48.948835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 662/1312] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:48.954689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876868-de34-42af-abaa-b67aeef5c17c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:48.955153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876868-de34-42af-abaa-b67aeef5c17c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:48.955263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876868-de34-42af-abaa-b67aeef5c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:49.028940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bf876868-de34-42af-abaa-b67aeef5c17c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:49.030165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bf876868-de34-42af-abaa-b67aeef5c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:49.129113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 651/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:49.413161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:49.414710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:49.519944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bdad9-7c96-42e6-96cf-347d624c0015 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:49.596057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:49.599128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:49.599927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:49.600375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:49.600868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:49.602670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:49.748484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:49.749899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8c8ce-56a3-4795-ba7b-4718c99c0e75 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:49.770176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 663/1314] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:52.156006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c058-2ee9-49f0-854a-19ba02132f9c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.156558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c058-2ee9-49f0-854a-19ba02132f9c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.156558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22c058-2ee9-49f0-854a-19ba02132f9c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.157899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 652/1315] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:52.165250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45123a-3181-424a-853f-5d57b634ac81 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.165837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45123a-3181-424a-853f-5d57b634ac81 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.166473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45123a-3181-424a-853f-5d57b634ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.242111 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2b45123a-3181-424a-853f-5d57b634ac81 None None] MFA Rules not processed for user `7a301020d0bc4b55a9a3731f0f6b65a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:52.243338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2b45123a-3181-424a-853f-5d57b634ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:52.334999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:52.396649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 664/1316] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:52.713456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.713771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.714119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.715492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 653/1317] 10.222.0.69 () {54 vars in 965 bytes} [Tue Aug 23 22:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:52.721688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809847-06dd-4255-8b57-74b58b099b81 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:52.721975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809847-06dd-4255-8b57-74b58b099b81 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:52.722258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809847-06dd-4255-8b57-74b58b099b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:52.807247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-21809847-06dd-4255-8b57-74b58b099b81 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:52.808470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-21809847-06dd-4255-8b57-74b58b099b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:52.891244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 665/1318] 10.222.0.69 () {58 vars in 1062 bytes} [Tue Aug 23 22:14:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:52.901701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:52.903765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:52.915598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:53.027882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d0233-4975-41cc-9436-61f0d8d0f46c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:53.111092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:53.111705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:53.111990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:53.112261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:53.114040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:53.188690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:53.241448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:53.242929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec06b76-8177-4423-8b0d-b2dce7e68df0 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:53.263947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 654/1319] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:14:56.182648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:56.183235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:56.183407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:56.184889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 666/1320] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:56.191798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda48e3-6cdf-4d94-a63e-e136c6238656 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:56.192353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda48e3-6cdf-4d94-a63e-e136c6238656 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:56.192353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda48e3-6cdf-4d94-a63e-e136c6238656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:56.269256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fbda48e3-6cdf-4d94-a63e-e136c6238656 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:56.271054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fbda48e3-6cdf-4d94-a63e-e136c6238656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:56.378064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 655/1321] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:14:56.664713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:56.666448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:56.729660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:56.793895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1955-6505-464d-a386-d5e1c42aaecb None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:56.878182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:56.878714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:56.878991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:56.879258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:56.880948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:56.987280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:57.003073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:57.004554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db4bbd-0fb9-4ce1-8a3a-7bd5a75d0e4c service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:57.026668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 667/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:59.953406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:59.953982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:59.953982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:59.955422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 656/1323] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:59.962174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e0cb-91d6-49a8-87ae-6c720505d9bb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:59.963785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e0cb-91d6-49a8-87ae-6c720505d9bb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:59.963785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2e0cb-91d6-49a8-87ae-6c720505d9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:00.044485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bfb2e0cb-91d6-49a8-87ae-6c720505d9bb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:00.045721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bfb2e0cb-91d6-49a8-87ae-6c720505d9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:00.181982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 668/1324] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:00.470680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:00.472270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:00.495914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:00.599289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd62b5b-8006-4e61-9ee0-f7e67083d099 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:00.684744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:00.685293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:00.685570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:00.685837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:00.687533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:00.776643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:00.832472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:00.834005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598c6ac-27e5-444b-940e-dc2372f4b160 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:00.855321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 657/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:02.894182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:02.894770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:02.894770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:02.896081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 669/1326] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:02.902392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba5dc0-cad7-4e4a-a35f-68a19f66d7a2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:02.903583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba5dc0-cad7-4e4a-a35f-68a19f66d7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:02.903583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba5dc0-cad7-4e4a-a35f-68a19f66d7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:02.974045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b0ba5dc0-cad7-4e4a-a35f-68a19f66d7a2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:02.975170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b0ba5dc0-cad7-4e4a-a35f-68a19f66d7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:03.082967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 658/1327] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:03.377367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:03.378937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:03.451333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:03.503369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a275b9-1655-4733-99e5-b812df817ea9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:03.585440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:03.585972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:03.586248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:03.586559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:03.588711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:03.711640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:03.715180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:03.716958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2937c7b-7429-4e68-bebe-eb4f6cde7963 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:03.737510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 670/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:05.773865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:05.774479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:05.774479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:05.776020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 659/1329] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:05.781721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768e61-9864-470e-9474-701bcfd002ec None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:05.782498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768e61-9864-470e-9474-701bcfd002ec None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:05.782498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6768e61-9864-470e-9474-701bcfd002ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:05.857457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e6768e61-9864-470e-9474-701bcfd002ec None None] MFA Rules not processed for user `7a301020d0bc4b55a9a3731f0f6b65a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:05.858685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e6768e61-9864-470e-9474-701bcfd002ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:05.980966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 671/1330] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:05 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:06.270359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:06.271915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:06.310310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:06.407572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04c00c-c358-4225-86dd-c24492cf01c2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:06.491455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:06.493067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:06.493365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:06.493652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:06.495404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:06.578978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:06.615073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:06.616528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d393d-7c99-4c17-b2b2-4b83eb7d8c00 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:06.639518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 660/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:08.903237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:08.903820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:08.903820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:08.905187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 672/1332] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:08.911549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e25b7-7909-4d17-bf0c-62d564f83780 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:08.912120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e25b7-7909-4d17-bf0c-62d564f83780 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:08.912120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e25b7-7909-4d17-bf0c-62d564f83780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:08.997294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6a2e25b7-7909-4d17-bf0c-62d564f83780 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:08.998590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6a2e25b7-7909-4d17-bf0c-62d564f83780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:09.102056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 661/1333] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:09.387120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:09.388694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:09.468858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:09.505282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa971cb-355b-48da-971a-1d4c731fe360 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:09.581858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:09.582611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:09.582936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:09.583289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:09.585011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:09.699953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:09.701339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5363-b56c-48f2-87c5-1236c032e54e service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:09.712693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:09.722484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 673/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:15:11.730881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:11.731645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:11.731645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:11.733034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 662/1335] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:11.739976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92ca4-dd07-45a1-8062-00402d347618 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:11.740583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92ca4-dd07-45a1-8062-00402d347618 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:11.740696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a92ca4-dd07-45a1-8062-00402d347618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:11.828913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c2a92ca4-dd07-45a1-8062-00402d347618 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:11.830145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c2a92ca4-dd07-45a1-8062-00402d347618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:11.946974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 674/1336] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:12.234544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:12.236084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:12.280387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:12.346402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35628d3-9c6d-4978-b70d-18c6a3c957a1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:12.422209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:12.422465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:12.422790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:12.423041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:12.424640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:12.510500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:12.537227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:12.538705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579d60e-1966-4b62-a876-8188502620e1 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:12.563986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 663/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:15.034282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:15.034845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:15.035009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:15.036402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 675/1338] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:15.042910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897cf5-d60c-46c9-8f2b-ed361f3eae1c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:15.043408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897cf5-d60c-46c9-8f2b-ed361f3eae1c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:15.043523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2897cf5-d60c-46c9-8f2b-ed361f3eae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:15.116133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f2897cf5-d60c-46c9-8f2b-ed361f3eae1c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:15.117412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f2897cf5-d60c-46c9-8f2b-ed361f3eae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:15.225694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 664/1339] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:15.516161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:15.517723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:15.597050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:15.626327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436632c-59cb-4e4f-b168-c05be83f3797 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:15.700603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:15.701175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:15.701697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:15.701959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:15.703559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:15.842422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:15.843898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae32d1-cd6d-4b1b-ac46-db794b854bfa service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:15.862838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 676/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:20.023917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.025047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.025182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.026953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 665/1341] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:20.032689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2d48-813c-434e-af07-e92e5a8ca02a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.033291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2d48-813c-434e-af07-e92e5a8ca02a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.033291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a2d48-813c-434e-af07-e92e5a8ca02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.039140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:20.112658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-033a2d48-813c-434e-af07-e92e5a8ca02a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:20.114234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-033a2d48-813c-434e-af07-e92e5a8ca02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:20.223773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 677/1342] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:20.534618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:20.536224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:20.594044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:20.660091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d97c4-7220-4169-aaab-1d920f85807f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:20.747020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:20.747553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:20.747836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:20.748105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:20.749792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:20.872833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:20.892247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:20.893631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33f316-996b-4f5c-9937-b100ad7220a6 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:20.918116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 666/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:15:23.726052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:23.726627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:23.726627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:23.728472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 678/1344] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:23.734379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb17a-15fe-402c-a61c-1814b94c9a2c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:23.735214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb17a-15fe-402c-a61c-1814b94c9a2c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:23.735214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcb17a-15fe-402c-a61c-1814b94c9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:23.823457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a1fcb17a-15fe-402c-a61c-1814b94c9a2c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:23.824779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a1fcb17a-15fe-402c-a61c-1814b94c9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:23.940224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 667/1345] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:24.235258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:24.237106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:24.340421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:24.362575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52a7bb-d30c-4b27-97ca-ff3744ebe24e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:24.445385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:24.446218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:24.446608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:24.446878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:24.448502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:24.584623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:24.586270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792809d-0bf9-4e68-bdf8-1a69d3232287 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:24.616208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 679/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:29.482279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:29.483074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:29.483074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:29.484235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 668/1347] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:29.491038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7915-267e-4470-a8e0-b45b4755870a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:29.491612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7915-267e-4470-a8e0-b45b4755870a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:29.492010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7915-267e-4470-a8e0-b45b4755870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:29.517314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:29.618341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-233b7915-267e-4470-a8e0-b45b4755870a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:29.619613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-233b7915-267e-4470-a8e0-b45b4755870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:29.773225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 680/1348] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:30.081182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:30.082946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:30.157534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.212069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ccbd-1a8e-4d12-b151-bd5b26d02acd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:30.323581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:30.324229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:30.324507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:30.324774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:30.326824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:30.482140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:30.488329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:30.490681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f014e-3954-4712-a499-691e35885c4b service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:30.517322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 669/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:37.098667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764dfb-749a-447b-8aac-ed7d2661f35f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:37.099248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764dfb-749a-447b-8aac-ed7d2661f35f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:37.099248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764dfb-749a-447b-8aac-ed7d2661f35f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:37.100896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 681/1350] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:37.107122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0fdfa-dc36-4c22-811f-0062c24cbbed None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:37.108093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0fdfa-dc36-4c22-811f-0062c24cbbed None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:37.108520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0fdfa-dc36-4c22-811f-0062c24cbbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:37.274032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a4c0fdfa-dc36-4c22-811f-0062c24cbbed None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:37.275396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a4c0fdfa-dc36-4c22-811f-0062c24cbbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:37.426829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 670/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:15:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:39.770810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=59 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.272557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77aeb-c355-4c0d-99b0-f598ff1824e9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.273305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77aeb-c355-4c0d-99b0-f598ff1824e9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.273305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f77aeb-c355-4c0d-99b0-f598ff1824e9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.274932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 682/1352] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:43.281373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fbaed-533c-4d2d-aaad-f2065abdcc7e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.282711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fbaed-533c-4d2d-aaad-f2065abdcc7e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.282711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fbaed-533c-4d2d-aaad-f2065abdcc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.370774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.417395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1f3fbaed-533c-4d2d-aaad-f2065abdcc7e None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:43.419615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1f3fbaed-533c-4d2d-aaad-f2065abdcc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:43.588478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 671/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:44.818675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83836f-c18a-458a-ad92-2b0f421b7c85 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.819280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83836f-c18a-458a-ad92-2b0f421b7c85 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.819280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83836f-c18a-458a-ad92-2b0f421b7c85 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.821160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 683/1354] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:44.827903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3a33-2f88-47a1-affc-df4911dfb396 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:44.828784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3a33-2f88-47a1-affc-df4911dfb396 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:44.828784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db3a33-2f88-47a1-affc-df4911dfb396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:44.920081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-18db3a33-2f88-47a1-affc-df4911dfb396 None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:44.921359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-18db3a33-2f88-47a1-affc-df4911dfb396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:44.968505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:45.038759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 672/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:15:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:48.143900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f05-e066-4ef4-9803-64b0f1381029 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.144504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f05-e066-4ef4-9803-64b0f1381029 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.144504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f05-e066-4ef4-9803-64b0f1381029 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.145832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 684/1356] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:48.151828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244acc-1235-490e-aa2e-6b45d3d7976c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.152378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244acc-1235-490e-aa2e-6b45d3d7976c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.152378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244acc-1235-490e-aa2e-6b45d3d7976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.228565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-25244acc-1235-490e-aa2e-6b45d3d7976c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:48.229902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-25244acc-1235-490e-aa2e-6b45d3d7976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:48.349372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 673/1357] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:48.664907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680062f-8537-491f-aaa0-307b2477893d None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.665521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680062f-8537-491f-aaa0-307b2477893d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.666027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680062f-8537-491f-aaa0-307b2477893d None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.667644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 685/1358] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 23 22:15:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:48.679427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb082-6a46-4f61-b76e-7ea05db4ba21 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:48.680495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb082-6a46-4f61-b76e-7ea05db4ba21 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:48.681540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb082-6a46-4f61-b76e-7ea05db4ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:48.704018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:48.804410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-30fcb082-6a46-4f61-b76e-7ea05db4ba21 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:48.806352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-30fcb082-6a46-4f61-b76e-7ea05db4ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:48.966421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 674/1359] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 23 22:15:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:48.975741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680062f-8537-491f-aaa0-307b2477893d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:48.978515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0680062f-8537-491f-aaa0-307b2477893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:49.180012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680062f-8537-491f-aaa0-307b2477893d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:49.328997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:49.381419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:49.382271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:49.383597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:49.384181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:49.386248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:49.553544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:49.557109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c849077-0f3a-43d0-97c7-24c4214df58e service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:49.593099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 686/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:52.093105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:52.093932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:52.093932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:52.095245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 675/1361] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:52.102658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ba65-5413-403e-afe5-d885a5abd508 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:52.104058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ba65-5413-403e-afe5-d885a5abd508 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:52.104600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ba65-5413-403e-afe5-d885a5abd508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:52.234548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4fd6ba65-5413-403e-afe5-d885a5abd508 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:52.235948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4fd6ba65-5413-403e-afe5-d885a5abd508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:52.308244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:52.455575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 687/1362] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:52.924735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:52.924735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:53.073782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:53.254466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d3bd1-665d-4ab0-aa1a-23330e28c691 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:53.517787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:53.518591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:53.519133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:53.521994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:53.524506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:53.571391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:53.717577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:53.719495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13cc12-c7f7-422b-bcca-c57447a047ee service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:53.761162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 676/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:15:57.018854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ddd4b-1984-47c5-89d8-40e575b00d31 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:57.019756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ddd4b-1984-47c5-89d8-40e575b00d31 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:57.019756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ddd4b-1984-47c5-89d8-40e575b00d31 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:57.021769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 688/1364] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:57.029783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0901-372f-4196-9d03-5706b0be4661 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:57.030732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0901-372f-4196-9d03-5706b0be4661 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:57.030732 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0901-372f-4196-9d03-5706b0be4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:57.139780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-361c0901-372f-4196-9d03-5706b0be4661 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:57.141237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-361c0901-372f-4196-9d03-5706b0be4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:57.309079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:57.320365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 677/1365] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:15:57.637852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:57.638385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:57.638979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:57.640842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 689/1366] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 23 22:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:57.652038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b267bf9-4fcb-4084-b0ff-e3b347ee5f6c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:57.652762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b267bf9-4fcb-4084-b0ff-e3b347ee5f6c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:57.653464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b267bf9-4fcb-4084-b0ff-e3b347ee5f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:57.806166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1b267bf9-4fcb-4084-b0ff-e3b347ee5f6c None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:57.807567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1b267bf9-4fcb-4084-b0ff-e3b347ee5f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:57.968268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 678/1367] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 23 22:15:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:57.977970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:57.979940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:58.180961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b38f5-8d38-4080-9856-1ffa3202d569 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:58.205778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:58.331040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:58.331978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:58.332498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:58.332983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:58.334875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:58.409696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284d8-1da1-460a-b003-8f5ad799f7c7 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:58.410332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284d8-1da1-460a-b003-8f5ad799f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:58.410332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f284d8-1da1-460a-b003-8f5ad799f7c7 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:58.412121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 679/1368] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:58.422699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142784-6679-4e2b-acd7-1dc622db66ef None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:58.423252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142784-6679-4e2b-acd7-1dc622db66ef None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:58.423615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a142784-6679-4e2b-acd7-1dc622db66ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:58.472616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:58.474473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29723dd2-a423-43f9-8ceb-2a53baf53ab3 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:58.502063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 690/1369] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:15:58.509129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:58.520596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7a142784-6679-4e2b-acd7-1dc622db66ef None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:58.522027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7a142784-6679-4e2b-acd7-1dc622db66ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:58.676378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 680/1370] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:59.689245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:59.690138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:59.690283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:59.692713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 691/1371] 10.222.0.69 () {54 vars in 964 bytes} [Tue Aug 23 22:15:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:15:59.702693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c67caa-db82-4546-bacf-1e4a33452603 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:59.703300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c67caa-db82-4546-bacf-1e4a33452603 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:59.703621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c67caa-db82-4546-bacf-1e4a33452603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:59.866017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-47c67caa-db82-4546-bacf-1e4a33452603 None None] MFA Rules not processed for user `3675dd6a15f146f69ce8ffd72fff2999`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:59.868890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-47c67caa-db82-4546-bacf-1e4a33452603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:00.005472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.020316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 681/1372] 10.222.0.69 () {58 vars in 1061 bytes} [Tue Aug 23 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:00.033302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:00.034946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:00.083873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.293284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ffe06-51fb-4160-ae97-6b5ae2088ce6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:00.407579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:00.407993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.408178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.408773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.419151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:00.657343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:00.724399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:00.724399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95585e0b-ebd5-4e4b-bf6c-cc2c6c444c84 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:00.753641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 692/1373] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:00.890536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.891636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.891636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:00.894385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 682/1374] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:00.904544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122614d-22fb-47e0-b253-10e5e1c4d9ce None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:00.905091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122614d-22fb-47e0-b253-10e5e1c4d9ce None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:00.905503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122614d-22fb-47e0-b253-10e5e1c4d9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:01.015926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9122614d-22fb-47e0-b253-10e5e1c4d9ce None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:01.017286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9122614d-22fb-47e0-b253-10e5e1c4d9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:01.182029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 693/1375] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:01.536662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:01.540441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:01.779524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1fca9-2386-4ac2-9280-e333675cb6c1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:01.883217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:01.951510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:01.952501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:01.952651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:01.952920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:01.954768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:02.101769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:02.104298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e188b-8ab6-4eaf-91ed-1439bc9eb7c0 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:02.140677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 683/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:04.274425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:04.274992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:04.274992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:04.277741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 694/1377] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:04.284971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3c26-3bed-49ee-9280-1153d23652dd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:04.285603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3c26-3bed-49ee-9280-1153d23652dd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:04.285603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d3c26-3bed-49ee-9280-1153d23652dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:04.385432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3c5d3c26-3bed-49ee-9280-1153d23652dd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:04.386722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3c5d3c26-3bed-49ee-9280-1153d23652dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:04.431995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:04.583788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 684/1378] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:04.890296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:04.893113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:04.967277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:05.170467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06891fee-bc6f-4b3a-a7c4-0f50d8852d5e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:05.338143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:05.343921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:05.344537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:05.344836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:05.345230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:05.348015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:05.457394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:05.459792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53c3ba-98a4-4401-b147-f896ab6800d5 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:05.489515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 695/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:07.860672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:07.861371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:07.861371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:07.862878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 685/1380] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:07.868924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab2c2-676b-48de-a059-1d9f42fe5619 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:07.869525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab2c2-676b-48de-a059-1d9f42fe5619 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:07.869525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ab2c2-676b-48de-a059-1d9f42fe5619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:07.953648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c89ab2c2-676b-48de-a059-1d9f42fe5619 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:07.955301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c89ab2c2-676b-48de-a059-1d9f42fe5619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:08.047541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:08.092963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 696/1381] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:08.412075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:08.414295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:08.640246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58cdbb-8f00-4a1c-9595-10b7d74ce1ff None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:08.658663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:08.799271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:08.799916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:08.800190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:08.800462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:08.802262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:08.910356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:08.911907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a27c42-d828-422b-aa15-da8afb68b563 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:08.938071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 686/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:11.073367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:11.074399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:11.074822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:11.077451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 697/1383] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:16:11.084002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34aab-e7ba-4178-862b-a3d20b288bae None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:11.085523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34aab-e7ba-4178-862b-a3d20b288bae None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:11.085795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34aab-e7ba-4178-862b-a3d20b288bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:11.112681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:11.172966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9ee34aab-e7ba-4178-862b-a3d20b288bae None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:11.174646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9ee34aab-e7ba-4178-862b-a3d20b288bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:11.308004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 687/1384] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:16:11.634898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:11.636428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:11.817048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83989c62-f8d3-483e-a19b-1add3066fc06 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:11.888295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:11.962513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:11.963365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:11.963728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:11.964079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:11.966461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:12.084071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:12.086950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7852781-71d8-4c9d-940a-913267832b41 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:12.108890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 698/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:14.177533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1168-8193-408c-9926-91011730803d None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:14.178120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1168-8193-408c-9926-91011730803d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:14.179254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b1168-8193-408c-9926-91011730803d None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:14.181740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 688/1386] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:14.189400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb28a1-c680-468d-b30b-d3768cbcaeef None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:14.190186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb28a1-c680-468d-b30b-d3768cbcaeef None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:14.190451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb28a1-c680-468d-b30b-d3768cbcaeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:14.282137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4fdb28a1-c680-468d-b30b-d3768cbcaeef None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:14.283780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4fdb28a1-c680-468d-b30b-d3768cbcaeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:14.300667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:14.418133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 699/1387] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:14.726265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b1168-8193-408c-9926-91011730803d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:14.728322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0f4b1168-8193-408c-9926-91011730803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:14.880276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:14.948096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b1168-8193-408c-9926-91011730803d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:15.097497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:15.098155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:15.098459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:15.098752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:15.101215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:15.174318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:15.209582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:15.212157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30170628-7460-4244-9622-88e7fa2f6f02 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:15.235915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 689/1388] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:17.227038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6764-d68e-41d1-a9b4-386ee6ae5aa8 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.228007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6764-d68e-41d1-a9b4-386ee6ae5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.228007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6764-d68e-41d1-a9b4-386ee6ae5aa8 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.229626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 700/1389] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:17.236752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1658d-ef5c-43dc-9414-572988b74411 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.237363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1658d-ef5c-43dc-9414-572988b74411 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.237713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1658d-ef5c-43dc-9414-572988b74411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.318338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a71a56-38b8-4690-ac92-420e30e3e528 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.318668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a71a56-38b8-4690-ac92-420e30e3e528 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.318885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a71a56-38b8-4690-ac92-420e30e3e528 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.321363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 701/1390] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:17.322062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0bc1658d-ef5c-43dc-9414-572988b74411 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:17.324348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0bc1658d-ef5c-43dc-9414-572988b74411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:17.327112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c928-2598-481d-be61-5fa3dc723a44 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.328294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c928-2598-481d-be61-5fa3dc723a44 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.328294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543c928-2598-481d-be61-5fa3dc723a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.426687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4543c928-2598-481d-be61-5fa3dc723a44 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:17.427947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4543c928-2598-481d-be61-5fa3dc723a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:17.468286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 690/1391] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:17.527342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:17.544919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 702/1392] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:16:17.789861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.790350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.790824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.793642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 691/1393] 10.222.0.69 () {54 vars in 967 bytes} [Tue Aug 23 22:16:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:17.802713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:17.803307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:17.803969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:17.842644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:17.844439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:17.897144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:17.909160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] MFA Rules not processed for user `76d8c7621f2a472ca879b60d7340edc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:17.910451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:18.028608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 703/1394] 10.222.0.69 () {58 vars in 1064 bytes} [Tue Aug 23 22:16:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:18.030438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e72adf-7942-447f-8915-8a513055b9df None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:18.037157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:18.047298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4f781-c9a5-4a4b-b52d-28112e5c6bde None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:18.149667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:18.150363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:18.150648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:18.150929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:18.152741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:18.156675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:18.257251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:18.262345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:18.263485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:18.263792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:18.264992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:18.267772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:18.316286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:18.318774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c20f-c187-40e4-93c2-443c3a107c76 service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:18.355423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 704/1395] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:16:18.418945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:18.419925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b589b45-aae2-44a3-af3e-9caf111c838a service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:18.463280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 692/1396] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:16:19.263880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40515e06-347a-4a9f-8a88-389b4a996be7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:19.264169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40515e06-347a-4a9f-8a88-389b4a996be7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:19.264613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40515e06-347a-4a9f-8a88-389b4a996be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:19.367038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-40515e06-347a-4a9f-8a88-389b4a996be7 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:19.368268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-40515e06-347a-4a9f-8a88-389b4a996be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:19.442379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:19.482678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 705/1397] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:16:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:19.550795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:19.551367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:19.551951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:19.555043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 693/1398] 10.222.0.69 () {54 vars in 943 bytes} [Tue Aug 23 22:16:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:19.565000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6881e-d539-4c00-974a-2e974b328eb9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:19.565433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6881e-d539-4c00-974a-2e974b328eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:19.565716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6881e-d539-4c00-974a-2e974b328eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:19.683711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9de6881e-d539-4c00-974a-2e974b328eb9 None None] MFA Rules not processed for user `783f430a59254acfbb4a7af3bb69b472`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:19.685463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9de6881e-d539-4c00-974a-2e974b328eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:19.838263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 706/1399] 10.222.0.69 () {58 vars in 1040 bytes} [Tue Aug 23 22:16:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:19.848372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:19.850118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:20.008659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:20.024734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a019b9-15d7-45fa-85cb-47e56bf6d772 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:20.218172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:20.219139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:20.219640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:20.220129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:20.223483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:20.380610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:20.382953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db608c-92c8-446e-b74b-7e3b9b1ff82c service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:20.394314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 694/1400] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:16:20.704340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:20.705249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:20.705249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:20.706483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 707/1401] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:20.713759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472806-eb98-4af2-955f-a6597cb8e01b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:20.714602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472806-eb98-4af2-955f-a6597cb8e01b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:20.714773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7472806-eb98-4af2-955f-a6597cb8e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:20.764044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:20.832786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e7472806-eb98-4af2-955f-a6597cb8e01b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:20.834139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e7472806-eb98-4af2-955f-a6597cb8e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:21.024405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 695/1402] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:21.349952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:21.354032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:21.426439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:21.605600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1a93f-a327-4798-a0bc-31816d1ecbef None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:21.768501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:21.774804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:21.775882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:21.776160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:21.776447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:21.778257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:21.898505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:21.901850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efbb08-c2e2-4431-8dec-bf2102e64e7c service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:21.943240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 708/1403] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:24.107091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:24.107699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:24.107699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:24.109041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 696/1404] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:24.114785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d7fd-b5d7-4a06-bd5d-41d6fae4fe6b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:24.115312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d7fd-b5d7-4a06-bd5d-41d6fae4fe6b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:24.115312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d7fd-b5d7-4a06-bd5d-41d6fae4fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:24.238919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c090d7fd-b5d7-4a06-bd5d-41d6fae4fe6b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:24.238919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c090d7fd-b5d7-4a06-bd5d-41d6fae4fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:24.351716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:24.419710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 709/1405] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:24.802106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:24.803820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:25.011323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:25.099710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8f32d-b6c5-4914-9e2c-a4d5e0006597 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:25.317329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:25.318441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:25.318901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:25.319898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:25.323493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:25.422116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:25.466114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:25.468057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779b1f7-f38b-45bf-831b-09586f0276db service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:25.505254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 697/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:16:27.715688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:27.716303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:27.716469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:27.722693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 710/1407] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:27.724629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda9b-3f37-48d2-a0c3-9bd1fedcc1c5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:27.725286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda9b-3f37-48d2-a0c3-9bd1fedcc1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:27.725592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeeda9b-3f37-48d2-a0c3-9bd1fedcc1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:27.843911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-aeeeda9b-3f37-48d2-a0c3-9bd1fedcc1c5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:27.845449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-aeeeda9b-3f37-48d2-a0c3-9bd1fedcc1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:28.044968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 698/1408] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:28.367877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:28.369989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:28.655404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d777f0-ed80-4229-9ebb-0a6d86ff5d72 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:28.771519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:28.870118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:28.871291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:28.871795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:28.872485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:28.875483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:29.048416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:29.051570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e33d0-66da-484a-9154-1fc88bc1ac2f service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:29.088031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 711/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:16:38.034871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=83 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:39.081278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=75 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:45.420698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee1abc-adca-4507-b530-6eea2ab8fb3f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:45.421307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee1abc-adca-4507-b530-6eea2ab8fb3f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:45.421307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee1abc-adca-4507-b530-6eea2ab8fb3f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:45.422729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 699/1410] 10.222.0.69 () {54 vars in 918 bytes} [Tue Aug 23 22:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:45.428952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad783-34c9-47c4-b5be-fbc410d99e6c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:45.429501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad783-34c9-47c4-b5be-fbc410d99e6c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:45.429501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad783-34c9-47c4-b5be-fbc410d99e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:45.525108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d1aad783-34c9-47c4-b5be-fbc410d99e6c None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:45.526326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d1aad783-34c9-47c4-b5be-fbc410d99e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:45.647070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 712/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Aug 23 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:45.662282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa25f1-e402-45a6-9c17-e4a676cdc1da None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:45.662562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa25f1-e402-45a6-9c17-e4a676cdc1da None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:45.662835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa25f1-e402-45a6-9c17-e4a676cdc1da None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:45.664207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 700/1412] 10.222.0.69 () {54 vars in 918 bytes} [Tue Aug 23 22:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:45.671351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2ddd-da73-4a9b-91c4-a12ad5081549 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:45.671564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2ddd-da73-4a9b-91c4-a12ad5081549 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:45.671816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb2ddd-da73-4a9b-91c4-a12ad5081549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:45.759447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:45.763620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-63cb2ddd-da73-4a9b-91c4-a12ad5081549 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:45.766174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-63cb2ddd-da73-4a9b-91c4-a12ad5081549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:45.941208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 713/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Tue Aug 23 22:16:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:49.143654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:49.144535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:49.144686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:49.148094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:16:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:49.157045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe110d-8625-439e-a53b-1266bddd2328 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:49.157890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe110d-8625-439e-a53b-1266bddd2328 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:49.158133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe110d-8625-439e-a53b-1266bddd2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:49.290911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2afe110d-8625-439e-a53b-1266bddd2328 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:49.293007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2afe110d-8625-439e-a53b-1266bddd2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:49.403940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:49.491892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:16:50.031367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:50.034382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:50.325388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d7d2c-0298-48c7-8389-5c5e5d8c2e41 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:50.476297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:50.543265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:50.544087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:50.544461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:50.544838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:50.546998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:50.713575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:50.715585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c429a2-b814-4584-b545-5998ee826445 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:50.739191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 702/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:52.293849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:52.294707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:52.294908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:52.297102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:16:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:52.305392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35853e-ec93-4c80-9eab-1eecee23d188 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:52.306252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35853e-ec93-4c80-9eab-1eecee23d188 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:52.306466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35853e-ec93-4c80-9eab-1eecee23d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:52.455798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1a35853e-ec93-4c80-9eab-1eecee23d188 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:52.457983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1a35853e-ec93-4c80-9eab-1eecee23d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:52.514236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:52.662701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:52.964101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:52.966003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:53.234338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3d07-5241-45ee-b119-d14e29c83530 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:53.289692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:53.386164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:53.387313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:53.387313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:53.387610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:53.389112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:53.540249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:53.543234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37bd77-840e-4cd5-ac5b-92a4b918bf59 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:53.580634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 716/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:54.726074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:54.727013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:54.727013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:54.728539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:54.735182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cca1a-17b8-4bfd-9e50-14b4e2dc8163 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:54.736070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cca1a-17b8-4bfd-9e50-14b4e2dc8163 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:54.736070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cca1a-17b8-4bfd-9e50-14b4e2dc8163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:54.846287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:54.875992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-490cca1a-17b8-4bfd-9e50-14b4e2dc8163 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:54.877374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-490cca1a-17b8-4bfd-9e50-14b4e2dc8163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:55.023097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:16:55.220281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:55.222564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:55.501756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48159d-aefc-4c63-9318-5187c5901881 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:55.527894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:55.692127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:55.693415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:55.693792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:55.694231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:55.696422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:55.848078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:55.850765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0d28e-ad35-4271-9f56-3d71533f00ed service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:55.876702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 705/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:57.259183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:57.259843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:57.260014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:57.261561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:57.268519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c580-f3f8-45ca-9411-798a0b844965 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:57.269261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c580-f3f8-45ca-9411-798a0b844965 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:57.269526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c580-f3f8-45ca-9411-798a0b844965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:57.308117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:57.433361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-41d7c580-f3f8-45ca-9411-798a0b844965 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:57.435261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-41d7c580-f3f8-45ca-9411-798a0b844965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:57.636883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:16:57.913799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:16:57.916593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:58.139088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:58.215465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816d479-60f2-458f-8809-1215c10a4174 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:16:58.461477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:16:58.462610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:58.463140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:58.463658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:58.467379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:16:58.613606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:16:58.634462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:16:58.636206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a7f1-92ca-42b8-9838-915d5586ad31 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:16:58.663011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 719/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:16:59.764014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:59.764700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:59.764700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:59.766162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:16:59.772136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc28-5ce3-4264-89aa-cb7d19a9acbc None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:16:59.772898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc28-5ce3-4264-89aa-cb7d19a9acbc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:16:59.772898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6cc28-5ce3-4264-89aa-cb7d19a9acbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:16:59.867709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2ac6cc28-5ce3-4264-89aa-cb7d19a9acbc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:16:59.869009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2ac6cc28-5ce3-4264-89aa-cb7d19a9acbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:00.060019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:00.230704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:00.233634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:00.398487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:00.506920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38f6ea-19f8-4274-b331-22d1c8232459 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:00.696544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:00.697184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:00.697555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:00.697882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:00.699670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:00.795567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:00.873811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:00.875720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5d5a-e1b8-4433-82dc-58a8eed73ab0 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:00.899966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 708/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:01.935583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:01.936322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:01.936322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:01.937667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:01.944797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de479-df55-4bdf-88e8-ecaefd897b96 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:01.945449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de479-df55-4bdf-88e8-ecaefd897b96 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:01.945811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de479-df55-4bdf-88e8-ecaefd897b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:02.072272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-994de479-df55-4bdf-88e8-ecaefd897b96 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:02.073921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-994de479-df55-4bdf-88e8-ecaefd897b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:02.272367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:02.542937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:02.544896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:02.642320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:02.798293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99eac4-03fe-4708-8df9-20b40bd600c6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:02.980580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:02.981420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:02.981586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:02.981868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:02.983677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:02.993069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:03.139174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:03.141058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a859e7-b0b2-4297-b9bc-18db2433fa31 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:03.164381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 722/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:04.099877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:04.100506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:04.100506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:04.102134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:04.109239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367c31-4c6d-4135-869a-3876910b605a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:04.109836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367c31-4c6d-4135-869a-3876910b605a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:04.110258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56367c31-4c6d-4135-869a-3876910b605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:04.223231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-56367c31-4c6d-4135-869a-3876910b605a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:04.224617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-56367c31-4c6d-4135-869a-3876910b605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:04.337323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:04.378123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:04.555602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:04.557388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:04.582289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:04.795315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bd30e-8e0d-48c8-82e5-6ec42a33b23b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:04.954199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:04.990508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:04.991606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:04.992068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:04.992515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:04.994997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:05.129442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:05.132258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902ff29-8361-448a-92c5-beb19bd8b841 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:05.163223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 711/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:06.382025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.383053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.383053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.384091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:06.390901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bcc10-14e5-4ce1-a08e-9d082a416abb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:06.391511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bcc10-14e5-4ce1-a08e-9d082a416abb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:06.391648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bcc10-14e5-4ce1-a08e-9d082a416abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:06.501255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0f1bcc10-14e5-4ce1-a08e-9d082a416abb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:06.503112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0f1bcc10-14e5-4ce1-a08e-9d082a416abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:06.585983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:06.689324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:06.929372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:06.932252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:07.167142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8f3da-81a6-4462-b0ce-88d288aa2650 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:07.259867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:07.371774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:07.372551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:07.372975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:07.373351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:07.375913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:07.557625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:07.559775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c8b5-27f8-41e0-8ac9-0617f28f23bd service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:07.594354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 725/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:08.750522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.751727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.752111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.754147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:08.763438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb4d3b-4657-4704-9bca-fa95bbacb628 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.764143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb4d3b-4657-4704-9bca-fa95bbacb628 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.764143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb4d3b-4657-4704-9bca-fa95bbacb628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.892153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8bbb4d3b-4657-4704-9bca-fa95bbacb628 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:08.894357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8bbb4d3b-4657-4704-9bca-fa95bbacb628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:08.898213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:09.042392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:09.249501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:09.251664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:09.486976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7393-e129-456e-9c5e-2c03d768531e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:09.524566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:09.657067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:09.658134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:09.658638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:09.659141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:09.663493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:09.829337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:09.832592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4376ab-07e5-4beb-9117-464afe56ddcd service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:09.855847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 714/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:11.859047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:11.859762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:11.860417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:11.865128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:11.876284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f14-a403-4534-b043-b37aaf16a0e9 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:11.876902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f14-a403-4534-b043-b37aaf16a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:11.877389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b9f14-a403-4534-b043-b37aaf16a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:11.957863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:12.006632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fe0b9f14-a403-4534-b043-b37aaf16a0e9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:12.008386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fe0b9f14-a403-4534-b043-b37aaf16a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:12.182103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:12.516325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:12.517979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:12.673768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68644b-eb1b-48c0-b31d-5de316129522 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:12.725687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:12.784630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:12.785447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:12.785833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:12.786286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:12.788136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:12.956827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:12.959775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5234d-f59c-41a8-b011-dec73c05f15b service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:12.994850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 728/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:15.442883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:15.443500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:15.443500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:15.444880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:15.451248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2c3f3-f86a-403a-82a0-b81ea7d034a0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:15.451789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2c3f3-f86a-403a-82a0-b81ea7d034a0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:15.451789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2c3f3-f86a-403a-82a0-b81ea7d034a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:15.554739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fda2c3f3-f86a-403a-82a0-b81ea7d034a0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:15.557592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fda2c3f3-f86a-403a-82a0-b81ea7d034a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:15.576662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:15.718245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:16.105099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:16.106681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:16.275359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebfc69-22f9-47a3-b388-924d2a9c09eb None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:16.293475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:16.420292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:16.421265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:16.422036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:16.422670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:16.429073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:16.621576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:16.623284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e57bc-46b0-4da1-a71b-02437dfaa33f service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:16.651378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 717/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:19.436659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:19.437537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:19.437537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:19.438657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:19.446040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7706-16a6-4d76-a170-66af84e16d4f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:19.446697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7706-16a6-4d76-a170-66af84e16d4f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:19.447050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d7706-16a6-4d76-a170-66af84e16d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:19.535454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:19.568206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a35d7706-16a6-4d76-a170-66af84e16d4f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:19.570397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a35d7706-16a6-4d76-a170-66af84e16d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:19.734021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:20.047710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:20.049307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:20.251387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22698ece-05a7-46a8-8857-0d27fc84eb98 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:20.305317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:20.356591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:20.357304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:20.357758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:20.358249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:20.361612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:20.561471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:20.563718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb38cd5-b39e-4ca8-ad3a-689e551b34ce service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:20.602794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 731/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:22.927314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.928104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.928104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.930258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:22.936727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc5d3-c68e-47af-b66a-78f0c0bd3fb0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.937365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc5d3-c68e-47af-b66a-78f0c0bd3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.937365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7dc5d3-c68e-47af-b66a-78f0c0bd3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:23.024866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ac7dc5d3-c68e-47af-b66a-78f0c0bd3fb0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:23.026129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ac7dc5d3-c68e-47af-b66a-78f0c0bd3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:23.054387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:23.205899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:23.549644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:23.552266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:23.703110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a29571-eb56-400d-b4c9-5c665010bc9a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:23.727959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:23.801125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:23.802548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:23.802548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:23.802942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:23.804559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:23.965449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:23.967367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fec46e-269a-400f-b8e0-0fed0b654403 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:23.991617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 720/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:26.445746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:26.446607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:26.446607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:26.448144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:26.454418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bff8-1ec1-4593-ae9e-7a33b9e1a4bd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:26.454947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bff8-1ec1-4593-ae9e-7a33b9e1a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:26.455051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246bff8-1ec1-4593-ae9e-7a33b9e1a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:26.544276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:26.548066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c246bff8-1ec1-4593-ae9e-7a33b9e1a4bd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:26.550321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c246bff8-1ec1-4593-ae9e-7a33b9e1a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:26.669563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:26.965486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:26.967494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:27.115001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db526d-75b1-4996-977f-2f60b3cececd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:27.179274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:27.216150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:27.217274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:27.217772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:27.218264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:27.221640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:27.383846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:27.385254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e47d3-f398-40ad-b247-b2554b6ca599 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:27.415716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 734/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:29.569201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.569887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.569887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.571199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:29.577419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9c9-faca-40c0-80a9-e4b64fd3e92e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.577950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9c9-faca-40c0-80a9-e4b64fd3e92e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.577950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ff9c9-faca-40c0-80a9-e4b64fd3e92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.683751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-374ff9c9-faca-40c0-80a9-e4b64fd3e92e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:29.685849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-374ff9c9-faca-40c0-80a9-e4b64fd3e92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:29.731461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:29.820929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:30.144623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:30.147161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:30.294304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3d227-0492-40fb-8329-e7ba93a2eb6f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.330792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:30.394061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.394855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.396002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.396895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.398535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:30.576666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.579378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda26c8-f985-45ee-bdb8-749662aa5fc3 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.615708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 723/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:32.685352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:32.685965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:32.685965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:32.687213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:32.693770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e17ab-8478-4b5b-ae4c-e0bacc2788f0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:32.694712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e17ab-8478-4b5b-ae4c-e0bacc2788f0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:32.694712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e17ab-8478-4b5b-ae4c-e0bacc2788f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:32.780700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5e0e17ab-8478-4b5b-ae4c-e0bacc2788f0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:32.782149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5e0e17ab-8478-4b5b-ae4c-e0bacc2788f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:32.792492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:32.891229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:33.207510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:33.209218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:33.359769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9eb3-9405-4933-9c3d-a2072c1bebf2 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:33.420073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:33.453141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:33.453759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:33.454038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:33.454312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:33.456171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:33.578669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:33.580116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7e2bf-b1c5-48ec-ab62-2e2285d0a9cf service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:33.602262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 737/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:35.671654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:35.672256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:35.672256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:35.673526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:35.679352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a46b5-009a-40d8-bfea-06aa258bcd2d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:35.679917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a46b5-009a-40d8-bfea-06aa258bcd2d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:35.679917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a46b5-009a-40d8-bfea-06aa258bcd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:35.757209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1f2a46b5-009a-40d8-bfea-06aa258bcd2d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:35.758441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1f2a46b5-009a-40d8-bfea-06aa258bcd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:35.812115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:35.876955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:36.429224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:36.431034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:36.573867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853f61-0742-4310-ab7a-5f04dd894fcd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:36.626106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:36.670377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:36.671386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:36.671906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:36.672497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:36.675763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:36.829735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:36.833103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87393e2e-d48a-40b4-bff3-cc0e99b25ce3 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:36.854717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 726/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:38.884818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:38.885406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:38.885406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:38.886724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:38.892332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce922f-d543-4ea8-bb0b-01d3271f68b4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:38.892773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce922f-d543-4ea8-bb0b-01d3271f68b4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:38.892897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce922f-d543-4ea8-bb0b-01d3271f68b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:38.962204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-95ce922f-d543-4ea8-bb0b-01d3271f68b4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:38.963413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-95ce922f-d543-4ea8-bb0b-01d3271f68b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:38.983762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:39.070061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:39.359524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:39.361227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:39.482832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950eff7-34fd-4b1c-a78c-3ff361f3a43d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:39.565030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:39.575075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:39.575706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:39.575983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:39.576260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:39.577969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:39.694960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:39.696408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7718d9-eb26-48a5-b3cf-3db61ec84af3 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:39.715692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 740/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:41.738320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accade28-4996-4bdf-a243-af67950d6292 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:41.739358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accade28-4996-4bdf-a243-af67950d6292 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:41.739358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accade28-4996-4bdf-a243-af67950d6292 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:41.740680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:41.746710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24e4f-1148-4b60-a9c7-f68485a55c80 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:41.747265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24e4f-1148-4b60-a9c7-f68485a55c80 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:41.747265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c24e4f-1148-4b60-a9c7-f68485a55c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:41.825658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f6c24e4f-1148-4b60-a9c7-f68485a55c80 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:41.826953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f6c24e4f-1148-4b60-a9c7-f68485a55c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:41.881582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:41.944267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:42.232561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accade28-4996-4bdf-a243-af67950d6292 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:42.234163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-accade28-4996-4bdf-a243-af67950d6292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:42.342458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accade28-4996-4bdf-a243-af67950d6292 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:42.394431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:42.423526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:42.424151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:42.424429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:42.424698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:42.426407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:42.545783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:42.547239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5114b1e-e4e9-4fa8-a3ff-439437e80969 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:42.567029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 729/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:51.935934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=22 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:52.564494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=66 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:04.732717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb66c-7765-47be-980a-f143b895c3ec None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:04.733337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb66c-7765-47be-980a-f143b895c3ec None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:04.733337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbb66c-7765-47be-980a-f143b895c3ec None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:04.734540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 742/1471] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:04.740559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f44fb-3297-41c0-afa3-5b37cf755746 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:04.741113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f44fb-3297-41c0-afa3-5b37cf755746 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:04.741204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f44fb-3297-41c0-afa3-5b37cf755746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:04.817337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-dd5f44fb-3297-41c0-afa3-5b37cf755746 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:04.818589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-dd5f44fb-3297-41c0-afa3-5b37cf755746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:04.918215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 730/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:05.221820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:05.222106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:05.222861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:05.224256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 743/1473] 10.222.0.69 () {54 vars in 967 bytes} [Tue Aug 23 22:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:05.229720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf70be-6b92-4098-bc37-35364d872399 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:05.230079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf70be-6b92-4098-bc37-35364d872399 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:05.230358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf70be-6b92-4098-bc37-35364d872399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:05.431123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-94bf70be-6b92-4098-bc37-35364d872399 None None] MFA Rules not processed for user `76d8c7621f2a472ca879b60d7340edc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:05.432345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-94bf70be-6b92-4098-bc37-35364d872399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:05.454471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:05.530572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 731/1474] 10.222.0.69 () {58 vars in 1064 bytes} [Tue Aug 23 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:05.538858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:05.540439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:05.662843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddc9e1-963c-47b8-af2e-8d9d0ad0eaec None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:05.740499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:05.741246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:05.741352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:05.741590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:05.743179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:05.920350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:05.984526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:05.986574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d56c8-11e2-4448-99b1-008f915ddd0e service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:06.005506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 744/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:18:08.093794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:08.094398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:08.094398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:08.095749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 732/1476] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:08.102574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44affd2a-5bf5-4d59-9451-7cdc144161bb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:08.103231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44affd2a-5bf5-4d59-9451-7cdc144161bb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:08.103231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44affd2a-5bf5-4d59-9451-7cdc144161bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:08.182279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-44affd2a-5bf5-4d59-9451-7cdc144161bb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:08.183531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-44affd2a-5bf5-4d59-9451-7cdc144161bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:08.314086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 745/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:08.602986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:08.604539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:08.764077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113889a1-e468-46b9-8b8f-c4f09a472d09 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:08.832550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:08.891816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:08.892442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:08.892717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:08.893007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:08.893699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:08.895771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:18:08.895771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:18:08.895771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:18:08.897016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1fee-625a-4230-9f52-461fa38e669b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:08.919252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 733/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Tue Aug 23 22:18:08 2022] GET /identity/v3/projects => generated 2553 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:10.956090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:10.957730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:10.958219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:10.960879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 746/1479] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:10.966615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dd5f-0cab-49a1-999e-ad35745bd248 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:10.967146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dd5f-0cab-49a1-999e-ad35745bd248 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:10.967146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3dd5f-0cab-49a1-999e-ad35745bd248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:11.053989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d0a3dd5f-0cab-49a1-999e-ad35745bd248 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:11.055257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d0a3dd5f-0cab-49a1-999e-ad35745bd248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:11.208605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 734/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:11.512861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:11.515199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:11.530008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:11.720607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a90d77-2bbe-4718-9006-afca914d2eaf None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:11.815429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:11.855491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:11.856178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:11.856570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:11.856919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:11.858700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:11.952478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:11.954182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d74787-ac8d-4e8a-9499-fc9d13918b2d service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:11.974184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 747/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:18:14.215579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:14.216221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:14.216221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:14.218082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 735/1482] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:14.225561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a577df-cc98-4b8a-833a-5fca7f9bbac2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:14.226219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a577df-cc98-4b8a-833a-5fca7f9bbac2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:14.226418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a577df-cc98-4b8a-833a-5fca7f9bbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:14.325135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-75a577df-cc98-4b8a-833a-5fca7f9bbac2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:14.326456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-75a577df-cc98-4b8a-833a-5fca7f9bbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:14.387615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:14.449981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 748/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:15.017152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:15.020391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:15.055199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:15.143221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321aeb-2028-413c-a65d-f379f6ce0212 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:15.220483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:15.221237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:15.221394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:15.221664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:15.224107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:15.305798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:15.344344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:15.345541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4b722-5a4c-422f-a8af-d4062242c482 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:15.378130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 736/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:18:17.530875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:17.531529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:17.531529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:17.532759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 749/1485] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:17.540824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810692ff-723e-4be7-bdc9-2d871a2659ec None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:17.541396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810692ff-723e-4be7-bdc9-2d871a2659ec None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:17.541703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810692ff-723e-4be7-bdc9-2d871a2659ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:17.636170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-810692ff-723e-4be7-bdc9-2d871a2659ec None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:17.637432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-810692ff-723e-4be7-bdc9-2d871a2659ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:17.760252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 737/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:18.056054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:18.057644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:18.172564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99e096-7b78-41a0-893e-5624b058410a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:18.260526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:18.263077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:18.263814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:18.264144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:18.264854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:18.267130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:18.390475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:18.391811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13c0c8-d311-4698-811c-4c6ad5a0a755 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:18.412163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 750/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:18:20.545052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:20.545683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:20.545683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:20.546959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 738/1488] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:20.552939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67fec-3f99-4ebe-93ea-fc21a34916c1 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:20.553484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67fec-3f99-4ebe-93ea-fc21a34916c1 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:20.553484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de67fec-3f99-4ebe-93ea-fc21a34916c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:20.627631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5de67fec-3f99-4ebe-93ea-fc21a34916c1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:20.629451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5de67fec-3f99-4ebe-93ea-fc21a34916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:20.685106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:20.739547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 751/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:21.033548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:21.035650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:21.072599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:21.145406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af60d5-98b3-4432-a31c-a516ed0de4c9 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:21.224714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:21.225347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:21.225624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:21.225892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:21.227495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:21.313324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:21.347680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:21.349169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c1b6f-4647-43e4-b52d-94d5ee0c3ef6 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:21.368256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 739/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:18:23.639032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:23.639652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:23.639652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:23.640954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 752/1491] 10.222.0.69 () {54 vars in 927 bytes} [Tue Aug 23 22:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:18:23.647754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdf38-ee3c-4613-9d0f-817942ba2a13 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:23.648276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdf38-ee3c-4613-9d0f-817942ba2a13 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:23.648652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdf38-ee3c-4613-9d0f-817942ba2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:23.731135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5afcdf38-ee3c-4613-9d0f-817942ba2a13 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:23.732271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5afcdf38-ee3c-4613-9d0f-817942ba2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:23.847029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 740/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Tue Aug 23 22:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:24.141637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:24.144184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:24.266337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d60f6-e85f-4afe-b09b-51bba7f8c7ee None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:24.346546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:24.347794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:24.348183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:24.348331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:24.349997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:24.359622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:24.471238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:24.473508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b068f-b848-4c49-a779-9cb1d7323b46 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:24.494664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 753/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:18:33.845057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=82 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:34.492098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=50 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:43.063029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:43.064736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:43.064736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:43.158745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:43.159981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:43.302525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 741/1494] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:43.311337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:43.312263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:43.312263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:43.402041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:43.403397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:43.541736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 754/1495] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:43.547306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:43.549887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:43.569278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8db8a-e714-494a-8da1-63e12f9038a7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:43.660857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:43.705821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:43.706013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:43.706169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:43.706432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:43.707095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:19:43.707394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:43.708410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:43.708410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:19:43.708410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:19:43.709338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:43.723090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 742/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:19:43.731832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:43.743519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fccdd-319f-43cb-adf5-badcb689f937 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:43.825779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:43.869007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:43.869714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:43.869994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:43.870262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:43.871019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:43.873036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:43.873036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:19:43.873036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:19:43.874381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:43.943687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 755/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:19:43 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:19:43.948714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:43.950435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:43.994412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11662e8-3392-4b7e-9fae-240282b16fcd admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:44.115630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:44.116737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.116737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.117169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.118041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:44.119132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:44.119132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:19:44.119132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:19:44.120947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:44.184206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 743/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:19:43 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:19:44.189399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:44.192193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:44.293753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e47d-0e69-4c70-ae68-e67c7eeecf2a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:44.434737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:44.455899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:44.456935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.457570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.457853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.458678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:44.460393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:44.460393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:19:44.460393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:19:44.462019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:44.487659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 756/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:19:44.492873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:44.494413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:44.506947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457d6c2-3527-4c9e-979e-531094f4038e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:44.537128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:44.658742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:44.659801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.660298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.660788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.662038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:44.663991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:44.663991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:19:44.663991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:19:44.665793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cee98-45ae-4c8b-9ad8-15b339344496 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:44.692133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 744/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:19:44.697611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:44.700770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:44.766724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a2b1c-4f52-433b-9eb3-ac8abf2529d5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:44.926807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:44.927790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:44.928264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:44.928741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] PATH_INFO: `/v3/projects/0b4ee2112fa74d87a59b351974eb3e4f/users/85b2dc703ae54765b4b66b39b47f2cc7/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:44.971420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4ee2112fa74d87a59b351974eb3e4f, user_id=85b2dc703ae54765b4b66b39b47f2cc7, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:44.972659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:44.972659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:19:44.972659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:19:44.974878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e0c2e-9658-42a8-a7b1-15854aac14be admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:45.009331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 757/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:19:44 2022] PUT /identity/v3/projects/0b4ee2112fa74d87a59b351974eb3e4f/users/85b2dc703ae54765b4b66b39b47f2cc7/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:19:45.024177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5fb4-0f84-49e3-a65c-a93d60bc811d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:45.024548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5fb4-0f84-49e3-a65c-a93d60bc811d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:45.024854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b5fb4-0f84-49e3-a65c-a93d60bc811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:45.103887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ed6b5fb4-0f84-49e3-a65c-a93d60bc811d None None] MFA Rules not processed for user `85b2dc703ae54765b4b66b39b47f2cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:45.105290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ed6b5fb4-0f84-49e3-a65c-a93d60bc811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:45.232005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 745/1502] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:45.257448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:45.257952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:45.258464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:45.261026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 758/1503] 10.222.0.69 () {54 vars in 964 bytes} [Tue Aug 23 22:19:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:45.271373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e840-30b4-4b14-b26f-38d6271f5fc5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:45.271869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e840-30b4-4b14-b26f-38d6271f5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:45.272369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6e840-30b4-4b14-b26f-38d6271f5fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:45.333094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:45.418361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bca6e840-30b4-4b14-b26f-38d6271f5fc5 None None] MFA Rules not processed for user `3675dd6a15f146f69ce8ffd72fff2999`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:45.420481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bca6e840-30b4-4b14-b26f-38d6271f5fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:45.572627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 746/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Tue Aug 23 22:19:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:45.583893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:45.588905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:45.673897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:45.770726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda6dad-3140-47fa-b821-97422afce41d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:45.774880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:45.775752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:45.776122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:45.776486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:45.779136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:45.951125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:45.953683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:45.995377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 759/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:46.069735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661039-79d7-4ef4-bf26-f655a73bbf42 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:46.070218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661039-79d7-4ef4-bf26-f655a73bbf42 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:46.070712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62661039-79d7-4ef4-bf26-f655a73bbf42 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:46.073466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 747/1506] 10.222.0.69 () {52 vars in 830 bytes} [Tue Aug 23 22:19:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:46.080598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:46.082803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:46.196167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:46.254422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e08548-1409-42ef-aa19-79baa9733274 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:46.262572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:46.263635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:46.264109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:46.264625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] PATH_INFO: `/v3/users/85b2dc703ae54765b4b66b39b47f2cc7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:46.268171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b2dc703ae54765b4b66b39b47f2cc7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:46.270209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:46.270209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:19:46.270209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:19:46.272619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:46.384537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b2dc703ae54765b4b66b39b47f2cc7'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:46.385554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b2dc703ae54765b4b66b39b47f2cc7'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:46.400202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b2dc703ae54765b4b66b39b47f2cc7'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:46.401321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b2dc703ae54765b4b66b39b47f2cc7'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:46.427097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b2dc703ae54765b4b66b39b47f2cc7'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:46.467537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 760/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:19:46 2022] DELETE /identity/v3/users/85b2dc703ae54765b4b66b39b47f2cc7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:19:46.473086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:46.473931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:46.473931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:46.511668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:46.513190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:46.604721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 748/1508] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:46.621286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:46.623732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:46.780389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e08f0-7bf3-47b8-9763-e307639b95d3 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:46.786327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:46.787004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:46.787281 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:46.787612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:46.798872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:46.800470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95027c-b8a0-454d-b049-02bdc7318f65 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:46.816030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 761/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:47.399303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:47.401549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:47.419484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888bc86-a5d8-43e6-a4b6-da1d14e41731 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:47.427772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:47.428635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:47.428978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:47.429251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] PATH_INFO: `/v3/projects/0b4ee2112fa74d87a59b351974eb3e4f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:47.430570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4ee2112fa74d87a59b351974eb3e4f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:47.431633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:19:47.431633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:19:47.431633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:19:47.433024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:47.527622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:47.534932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4ee2112fa74d87a59b351974eb3e4f', 'request_id': 'req-7f998c83-e4e2-47ff-acab-be546edd18b3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:47.551387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4ee2112fa74d87a59b351974eb3e4f', 'request_id': 'req-7f998c83-e4e2-47ff-acab-be546edd18b3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:47.559477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4ee2112fa74d87a59b351974eb3e4f', 'request_id': 'req-7f998c83-e4e2-47ff-acab-be546edd18b3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:47.581308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] The token cache is being invalidate because project 0b4ee2112fa74d87a59b351974eb3e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:19:47.581702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:47.582658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7f998c83-e4e2-47ff-acab-be546edd18b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:19:47.584406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 749/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:19:47 2022] DELETE /identity/v3/projects/0b4ee2112fa74d87a59b351974eb3e4f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:19:56.809703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:57.575297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:29.225071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.225729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.225729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.226916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:29.232742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a9e3-d248-4d27-ae17-0d0244e3f0ea None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.233444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a9e3-d248-4d27-ae17-0d0244e3f0ea None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.233565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a9e3-d248-4d27-ae17-0d0244e3f0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.295466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c330a9e3-d248-4d27-ae17-0d0244e3f0ea None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:29.298607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c330a9e3-d248-4d27-ae17-0d0244e3f0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:29.374676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:29.560991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:29.564377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:29.694029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfa6e-263b-4947-bdf4-a93dc62d8649 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:29.702739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:29.703475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:29.703703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:29.703978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:29.714633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:29.716959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11c16a-ab74-4ee7-acb2-2a3d4748c4a8 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:29.729633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 763/1513] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:30.630900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c14a-2744-4ac7-9ed4-39ec1499e66b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:30.631645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c14a-2744-4ac7-9ed4-39ec1499e66b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:30.631645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9c14a-2744-4ac7-9ed4-39ec1499e66b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:30.632900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:30.638135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a160-74e0-4199-97f2-e708e59ea48e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:30.638668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a160-74e0-4199-97f2-e708e59ea48e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:30.638776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400a160-74e0-4199-97f2-e708e59ea48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:30.660398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-2400a160-74e0-4199-97f2-e708e59ea48e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:30.661662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2400a160-74e0-4199-97f2-e708e59ea48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:30.670147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:30.825523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c14a-2744-4ac7-9ed4-39ec1499e66b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:30.842289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9c14a-2744-4ac7-9ed4-39ec1499e66b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:30.848103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:30.848926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:30.849196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:30.849500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:30.859672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:30.861312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7a8b-3467-4260-aa9c-97ac0ab63de9 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:30.871305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 752/1516] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:31.017325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb935b2-d37a-4121-8131-64938de7a850 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:31.017606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb935b2-d37a-4121-8131-64938de7a850 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:31.017878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb935b2-d37a-4121-8131-64938de7a850 None None] PATH_INFO: `/v3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:31.019145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 765/1517] 10.222.0.71 () {54 vars in 925 bytes} [Tue Aug 23 22:21:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:21:31.026038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d45e-dd14-48da-b234-d27a95f49b15 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:31.026325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d45e-dd14-48da-b234-d27a95f49b15 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:31.026606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774d45e-dd14-48da-b234-d27a95f49b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:31.088861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0774d45e-dd14-48da-b234-d27a95f49b15 None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:31.090083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0774d45e-dd14-48da-b234-d27a95f49b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:31.164595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 753/1518] 10.222.0.71 () {58 vars in 1015 bytes} [Tue Aug 23 22:21:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:40.481988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fbd5e-1df2-48b3-8b2f-5229c5f47ea7 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:40.482652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fbd5e-1df2-48b3-8b2f-5229c5f47ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:40.482652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fbd5e-1df2-48b3-8b2f-5229c5f47ea7 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:40.484746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 766/1519] 10.222.0.69 () {54 vars in 961 bytes} [Tue Aug 23 22:21:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:40.490628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8808ff-4c88-4ad0-8e6f-00f969c2475a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:40.491159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8808ff-4c88-4ad0-8e6f-00f969c2475a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:40.491159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8808ff-4c88-4ad0-8e6f-00f969c2475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:40.511568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-dd8808ff-4c88-4ad0-8e6f-00f969c2475a None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:40.512828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-dd8808ff-4c88-4ad0-8e6f-00f969c2475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:40.521709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 754/1520] 10.222.0.69 () {58 vars in 1058 bytes} [Tue Aug 23 22:21:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:40.530796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fbd5e-1df2-48b3-8b2f-5229c5f47ea7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:40.544418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fbd5e-1df2-48b3-8b2f-5229c5f47ea7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:40.550377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:40.551055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:40.551329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:40.551622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:40.560473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:40.562697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4bacb-b353-4a09-81be-949a170bf6be service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:40.573020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 767/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:42.137146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42915c5-4c0d-43ed-ac9c-3cc9f74ecaf1 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:42.137733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42915c5-4c0d-43ed-ac9c-3cc9f74ecaf1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:42.137733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42915c5-4c0d-43ed-ac9c-3cc9f74ecaf1 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:42.139117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:42.144318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ffe-eea6-4cf0-bb24-e552c90bf115 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:42.144798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ffe-eea6-4cf0-bb24-e552c90bf115 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:42.144927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df11ffe-eea6-4cf0-bb24-e552c90bf115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:42.165425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9df11ffe-eea6-4cf0-bb24-e552c90bf115 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:42.166636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9df11ffe-eea6-4cf0-bb24-e552c90bf115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:42.175592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:42.331328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42915c5-4c0d-43ed-ac9c-3cc9f74ecaf1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:42.346403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42915c5-4c0d-43ed-ac9c-3cc9f74ecaf1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:42.351943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:42.352544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:42.352848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:42.353124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:42.362618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:42.364208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9b69e-e0cd-40be-8460-a13504058d3e service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:42.368136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:42.375922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 756/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:43.208595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460ca7b-d88c-40ff-ae7b-3b722b59da25 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:43.209179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460ca7b-d88c-40ff-ae7b-3b722b59da25 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:43.209179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460ca7b-d88c-40ff-ae7b-3b722b59da25 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:43.210395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:43.215292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50377-087a-49bd-8bca-b1639a66b3f5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:43.215753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50377-087a-49bd-8bca-b1639a66b3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:43.216041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c50377-087a-49bd-8bca-b1639a66b3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:43.236543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-79c50377-087a-49bd-8bca-b1639a66b3f5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:43.237814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-79c50377-087a-49bd-8bca-b1639a66b3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:43.245766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:43.399271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460ca7b-d88c-40ff-ae7b-3b722b59da25 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:43.414839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460ca7b-d88c-40ff-ae7b-3b722b59da25 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:43.421205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:43.422170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:43.422170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:43.422380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:43.431266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:43.432866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0c935-69da-4c33-a66c-90a09ad3f203 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:43.442646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 770/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:47.249532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:47.250155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:47.250155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:47.251507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:47.257710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b7cf-27e6-4c42-8299-6d66558798fb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:47.258285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b7cf-27e6-4c42-8299-6d66558798fb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:47.258285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b7cf-27e6-4c42-8299-6d66558798fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:47.279090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-dfa3b7cf-27e6-4c42-8299-6d66558798fb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:47.280606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-dfa3b7cf-27e6-4c42-8299-6d66558798fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:47.289085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:47.570962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:47.573060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:47.633931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122015f0-179f-4c78-a49d-7b9f04015cb5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:47.637552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:47.638199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:47.638476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:47.638748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:47.648500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:47.649977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911514f4-5ba2-43ca-abfe-689cc59bf62d service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:47.660025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 759/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:49.604393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aa53-208a-4f8c-82a8-0de7f47961f3 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:49.604944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aa53-208a-4f8c-82a8-0de7f47961f3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:49.604944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804aa53-208a-4f8c-82a8-0de7f47961f3 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:49.606215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:21:49.612102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b7c9-f1e9-433a-9a4c-6a4bed2084b0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:49.612548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b7c9-f1e9-433a-9a4c-6a4bed2084b0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:49.612660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55b7c9-f1e9-433a-9a4c-6a4bed2084b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:49.632785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bc55b7c9-f1e9-433a-9a4c-6a4bed2084b0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:49.634007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bc55b7c9-f1e9-433a-9a4c-6a4bed2084b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:49.642606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:49.927431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804aa53-208a-4f8c-82a8-0de7f47961f3 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:49.939278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804aa53-208a-4f8c-82a8-0de7f47961f3 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:49.943064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:49.943675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:49.943935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:49.944203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:49.954898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:49.956588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7a82-3d16-4033-bd79-2177c322f2f2 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:49.966446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 773/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:53.811599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:53.812219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:53.812219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.813625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:21:53.819269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2bd9-5622-4f77-8bb6-de60c3337bd3 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:53.819779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2bd9-5622-4f77-8bb6-de60c3337bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:53.819886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c2bd9-5622-4f77-8bb6-de60c3337bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:53.841350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ac9c2bd9-5622-4f77-8bb6-de60c3337bd3 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:53.842641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ac9c2bd9-5622-4f77-8bb6-de60c3337bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:53.850812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:54.424431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:54.426112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:54.485534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024110-3b61-4447-a80f-34988fcc26a4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:54.489177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:54.489786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:54.490061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:54.490331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:54.499795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:54.501301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c7baf-151d-4b84-9904-b71b8e030e93 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:54.512068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 762/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:21:56.463787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:56.464357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:56.464357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:56.465677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:21:56.471762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2cce-fbe0-4693-9af9-8ec28532ec03 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:56.472277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2cce-fbe0-4693-9af9-8ec28532ec03 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:56.472381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2cce-fbe0-4693-9af9-8ec28532ec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:56.493091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-775c2cce-fbe0-4693-9af9-8ec28532ec03 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:56.494302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-775c2cce-fbe0-4693-9af9-8ec28532ec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:56.502523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:21:57.072073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:21:57.074055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:57.082408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=77 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:57.088636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c2120-b18c-4740-b69b-4d46559f02c9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:21:57.093149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:21:57.093814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:57.094167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:57.094288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:57.103968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:21:57.105445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c097b31f-d8ef-411e-b81a-e8b258821155 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:21:57.116013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 776/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:06.487726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=62 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:07.111586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:32.914237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:32.916264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:32.917093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:32.978988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:32.981341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.015332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 764/1540] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:33.026477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.027406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.027406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.060901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.062864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.081311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 777/1541] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.087109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.118573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8363ec7-76c9-4da0-a79c-9951ebb98fa6 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.141038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.145261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.148790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.148790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.148790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:33.148790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.152370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.204401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 765/1542] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:23:33.213259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.228539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be0b5-3f7f-487a-9647-9570d74059bc None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.241435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.242231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.242506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.242789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.243451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.245482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18480dc9-61e9-4e85-b358-d8dbe72a92bf admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.309938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 778/1543] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:33.317419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.365156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d66a0-1f22-4d2f-ae39-56e75afb70cc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.522221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4db-7745-4166-ac7a-7868fb56573c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.522791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4db-7745-4166-ac7a-7868fb56573c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.523266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4db-7745-4166-ac7a-7868fb56573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.581774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fb97c4db-7745-4166-ac7a-7868fb56573c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.583312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fb97c4db-7745-4166-ac7a-7868fb56573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.590105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.596832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 779/1544] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:33.600830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.600830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.600830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.600830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.603826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7e314-77ed-4e4d-91c4-7fb10de32673 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.648785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986d46-a571-49e5-90db-4864ace382f4 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.649382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986d46-a571-49e5-90db-4864ace382f4 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.649864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0986d46-a571-49e5-90db-4864ace382f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.677461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 766/1545] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/users => generated 289 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:33.680881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac965fc-21c4-40e3-ba7e-c82026965b4e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.680881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac965fc-21c4-40e3-ba7e-c82026965b4e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.681281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac965fc-21c4-40e3-ba7e-c82026965b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.690956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c0986d46-a571-49e5-90db-4864ace382f4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.692210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c0986d46-a571-49e5-90db-4864ace382f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.707752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 780/1546] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.724090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.725149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.725487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.755384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4ac965fc-21c4-40e3-ba7e-c82026965b4e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.758016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4ac965fc-21c4-40e3-ba7e-c82026965b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.765121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.766391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.788162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 781/1547] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.789179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.789301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 767/1548] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.791381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.791863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.792326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.812366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac83a4f-ff42-471e-aad1-165c06b8e4aa None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.828136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.828769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.829093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.829365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.830030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.833176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.846948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 782/1549] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:33.847646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.863715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173bace-047a-471b-8b1c-ed6575f32cae admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.865048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.867618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.868719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.869374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.869657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.869933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.870688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:33.870998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.872341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:33.872341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:23:33.872341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:23:33.874365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119df1f-61d8-45df-9de0-cb7e01994d30 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.890089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 783/1550] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:33.891419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4da4d-2d6e-4373-8515-667722753540 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.891710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4da4d-2d6e-4373-8515-667722753540 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.892404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4da4d-2d6e-4373-8515-667722753540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.905364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 768/1551] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.907320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.914631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-faf4da4d-2d6e-4373-8515-667722753540 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.915894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-faf4da4d-2d6e-4373-8515-667722753540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.925440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 784/1552] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.926715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.927005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.927290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.927705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845d59f-fe08-4f4b-bf3d-315d33b33814 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.941731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.943314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.944043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.944527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.945731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.948659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:33.949665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d23ead9-51b1-4827-ab58-602de259dc58 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:33.949993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:33.960399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 785/1553] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:33.964912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:33.971825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 769/1554] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:33.980830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5494d-50c1-4fde-a87b-8a1a5a4586b7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.980830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5494d-50c1-4fde-a87b-8a1a5a4586b7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.980830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5494d-50c1-4fde-a87b-8a1a5a4586b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.985213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca5a97-4f99-4dc8-8ac3-5fb2cf09cc09 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:33.990603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:33.991268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:33.991580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:33.992023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:33.992683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:33.994803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.000195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-20c5494d-50c1-4fde-a87b-8a1a5a4586b7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.001394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20c5494d-50c1-4fde-a87b-8a1a5a4586b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.010514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 770/1555] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.012089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.012468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.012625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.034922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 786/1556] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:33 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.036905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.047425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.049200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.114587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d194c-90ba-40b0-ba37-60664530a210 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.118725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 771/1557] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.122224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.122396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.124443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.124986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.125492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.126609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.127151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.130280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89c5e-cc69-44b4-8eb3-fec3827b3ce0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.134139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab18af-69cf-4eb3-9b4d-6204d285675d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.139668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.140296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.140582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.141036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.141565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.141878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.143520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.152919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 787/1558] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.154710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508c3f-919a-417a-b524-f10c0d4d4869 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.155348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508c3f-919a-417a-b524-f10c0d4d4869 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.155568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00508c3f-919a-417a-b524-f10c0d4d4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.164892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 772/1559] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.164892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.171668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639fa23-80e4-4588-b0b2-a0c55b6a546a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.177395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.178088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.178359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.178901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] PATH_INFO: `/v3/projects/486ecf70fd6143a6a59e038957b06d50/users/4cf5be327ff749ee901f5fb33ab9f6c8/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.180904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-00508c3f-919a-417a-b524-f10c0d4d4869 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.182151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-00508c3f-919a-417a-b524-f10c0d4d4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.191658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 788/1560] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.193357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.193643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.194071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.197874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=486ecf70fd6143a6a59e038957b06d50, user_id=4cf5be327ff749ee901f5fb33ab9f6c8, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.199162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:34.199162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:23:34.199162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:23:34.201431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01e28c-5f1a-4ee0-90ee-62b45b55c72d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.218720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 773/1561] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:34 2022] PUT /identity/v3/projects/486ecf70fd6143a6a59e038957b06d50/users/4cf5be327ff749ee901f5fb33ab9f6c8/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:34.220356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.222367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.222564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4358a0-0481-4a2b-902e-86403bf35bf1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.223071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4358a0-0481-4a2b-902e-86403bf35bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.223391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4358a0-0481-4a2b-902e-86403bf35bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.234715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.257987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8e4358a0-0481-4a2b-902e-86403bf35bf1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.259622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8e4358a0-0481-4a2b-902e-86403bf35bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.267520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.312725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 789/1562] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.313584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.326431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63ed4-1da7-480f-8020-6d70b41a3090 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.331475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.332085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.332372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.332663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.333333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.334378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:34.334378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:23:34.334378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:23:34.335610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.353975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 774/1563] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.358610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.358896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.359239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.360310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 790/1564] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.361159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.371855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0bb60-126a-4c0b-9972-ed01579b8459 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.377957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.378569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.378844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.379112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.379735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.380337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.381598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.381739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.390965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 775/1565] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.391785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.408393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4b1bf-11f6-4ee8-ad96-16335ae9c8a9 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.414850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.419553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.419553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.419553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.419919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 791/1566] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.420214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.420310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.420396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:34.420396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:23:34.420396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:23:34.420396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5bb5b-19d0-460e-b54c-66e6e1656d77 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.450116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 776/1567] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.455591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23911-bef4-4a0a-a6ae-0d7246236ee6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.455863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23911-bef4-4a0a-a6ae-0d7246236ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.456283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f23911-bef4-4a0a-a6ae-0d7246236ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.475560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b4f23911-bef4-4a0a-a6ae-0d7246236ee6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.476789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b4f23911-bef4-4a0a-a6ae-0d7246236ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.490829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50abe26-f9a7-4574-8f8f-9047f014d435 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.546556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 777/1568] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.548201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.548484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.548759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.567691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.568487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.568925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.569352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.569932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:34.570584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.571021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.571202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:34.574143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.581338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 778/1569] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:34.582278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.592878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d117e-a950-418c-9319-6a33858f3fd2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.600930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 792/1570] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.600930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.603326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.603997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.604285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.604564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.605252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.605631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.607937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.609260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8f9fc-c03c-4da3-a516-358e212c9193 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.614221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.614844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.615136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.615413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.616228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.617942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.622273 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 779/1571] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.623766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.638843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 793/1572] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:34.638843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.642544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459efa75-ff0a-4326-99ce-4f24c9b1d525 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.647534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.648107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca840c-c717-4f6b-9cde-e914859978d1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.648243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.648425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.648699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.649398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.649705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.651368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.653341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.654980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.655270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.655547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.656321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.658467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.666472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 780/1573] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.674041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.687744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 794/1574] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/users => generated 284 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.687982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4930892-f1f8-441a-a5c8-db4be1cb9c66 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.688090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.691393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.691643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.692313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.692594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.692935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.693658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.695551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.720967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 781/1575] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.721724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.733245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304995e9-2474-42a0-a0ab-4903666b7627 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.738385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.739092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.739375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.739782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.740444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:34.740750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.742593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.757516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 782/1576] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:34.758478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.762390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7344-e262-45ba-be68-ad2c94da5e98 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.767269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.768366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.768718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.769097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.775540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531e0d3-3ace-4c4a-b150-367777475325 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.780791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.782388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.783893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.784881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.785364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.785832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.786940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.790831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.796541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 795/1577] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:34.797166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.807020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:34.808787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fa0b8-7c1a-49af-b9f5-9dcf9e41d835 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.815788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.816786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.817167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.817430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.818380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.820830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.834451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 783/1578] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/projects => generated 391 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.835529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.861003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 796/1579] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.862215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:34.927995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8374-8caa-4b29-a2e4-087f5fbf0ed1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.948881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec3df8-cb5e-400e-bcc9-62a8b8d3a523 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:34.955520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:34.956226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:34.956517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:34.956957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:34.957652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:34.959751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:34.994279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 797/1580] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:34 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:34.995106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.004072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.004751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.005070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.005355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.006034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.007909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.020705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 784/1581] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.021682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.039491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd572d-457a-4df7-b287-1c074f48e8a2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.130654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a478d5-7560-4283-90f6-d41215afc5f7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.140129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.141294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.141640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.142197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.142524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.142827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.142938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.143376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.143740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.144675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.145667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.146768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.160594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 798/1582] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.162674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.172524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 785/1583] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.172524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.180311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735a351-2220-4fe7-bbed-e4c26ab3eb4c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.183331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb3ebb-2b1b-4951-af6c-fbebf764f95a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.187326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.188009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.188352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.189026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.189688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.191838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.193655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.195272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.196007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.197040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.197424 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:35.198366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.202662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.236420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 799/1584] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:35.241821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.246042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 786/1585] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/users => generated 296 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:35.246042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.280618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dfe14-2c3a-4c97-b85a-922a57f7fdf2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.301258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:35.330960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6e11-537d-4c6e-9f34-4607703f3a01 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.338843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.340304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.340693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.341106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.343038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.346375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.377094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 800/1586] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:35.378599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.389987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.390630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.390916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.391192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.391877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.393242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a3eb7-8cd2-4626-a854-6cd688ae9e54 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.397725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.401604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.402548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.402894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.403366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] PATH_INFO: `/v3/projects/d12eee1d70624f5b8ce23d58abad3edd/users/26fb71ec9dc74d898345bf60409d4132/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.426266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12eee1d70624f5b8ce23d58abad3edd, user_id=26fb71ec9dc74d898345bf60409d4132, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.429036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 787/1587] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:35.429767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.433109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.442078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9687d-70de-4356-8758-c8f0b1867116 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.451892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 801/1588] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:35 2022] PUT /identity/v3/projects/d12eee1d70624f5b8ce23d58abad3edd/users/26fb71ec9dc74d898345bf60409d4132/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:35.453098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.551960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.552606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.553171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.553432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.553541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f6ca8-bdd6-4267-9b64-d5e3ae7c1bf6 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.554268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.556075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.559716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.561140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.561479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.561832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.562685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.564537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.569417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 788/1589] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.570327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.580474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 802/1590] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.580474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.588744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd2ae5-4c68-4633-8064-e4b9d24e1e52 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.592939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb225e0-1a81-4c15-93d4-6126d7734532 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.599795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.600736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.601193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.601335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.601642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.602025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.602314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.602467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.602571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.603478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.604121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.605807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.620852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 803/1591] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.620852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.640362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10eaba8-db13-4de1-8965-ce3d9262a5d9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.641588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 789/1592] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/users => generated 291 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:35.643271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.649141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.650820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.651307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.651814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.653445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.656784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571951e-c2cd-4e5f-a598-20290e33b4f5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.663047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46fae5-cde9-4c94-a7df-2a5368e1908e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.667428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.667689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.668081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.668456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.669626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.671826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.681170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 804/1593] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.682654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.683847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.684137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.690541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 790/1594] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.691779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.709905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d524d-8900-4ff1-9128-53e766cfa790 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.723461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.727029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.727337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.727625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] PATH_INFO: `/v3/projects/61fb584763c54c339f391cbfc3e90045/users/06756a5513104a68bca647da9e1b48a7/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.729166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] MFA Rules not processed for user `26fb71ec9dc74d898345bf60409d4132`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:35.730705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:35.749488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:35.757316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fb584763c54c339f391cbfc3e90045, user_id=06756a5513104a68bca647da9e1b48a7, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.761646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.784250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 791/1595] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:35 2022] PUT /identity/v3/projects/61fb584763c54c339f391cbfc3e90045/users/06756a5513104a68bca647da9e1b48a7/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:35.785826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.852627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:35.867650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 805/1596] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:35.869319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.884229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2834-523a-48bd-b551-19dc6864f25f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.891783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.893044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.893375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.893912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] PATH_INFO: `/v3/projects/af3d0801b6ff4a79a0bd66f89e094d00/users/44f446bb29f548e0bc392fead9b8bf49/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.894084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb521b9-22b4-4d88-99a0-6a8ed4db2691 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.901525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.902230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.902516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.902793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.903453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.905695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.918105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3d0801b6ff4a79a0bd66f89e094d00, user_id=44f446bb29f548e0bc392fead9b8bf49, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.922134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 806/1597] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.923135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.928410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.934537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17461f-98de-4c3e-a8a7-eea12fa5a758 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:35.941844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:35.943128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:35.943128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:35.943473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:35.944183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:35.946054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:35.952003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 792/1598] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:35 2022] PUT /identity/v3/projects/af3d0801b6ff4a79a0bd66f89e094d00/users/44f446bb29f548e0bc392fead9b8bf49/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:35.953985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.961109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 807/1599] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:35.962052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:35.978460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad139f-1287-47fa-95b3-5d68cdfa7010 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.062621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b7ccf-d903-4c0c-b520-d0e0ea926640 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.074694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.075811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.076609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.077050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.077919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.079484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.080157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.080437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.080711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.081903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed91c1-4fea-426a-9234-b1e56209a9a6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.082238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.084870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251f2d-2f05-4273-a4da-2e2e69c4ba66 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.106231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 793/1600] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:36.107833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 808/1601] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:36.109771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.111028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.111270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f4f7e-941f-46d4-a093-a07b9ddcbc0f None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.111571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f4f7e-941f-46d4-a093-a07b9ddcbc0f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.111851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f4f7e-941f-46d4-a093-a07b9ddcbc0f None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.113469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.114183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 809/1602] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 23 22:23:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:36.115051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f4f7e-941f-46d4-a093-a07b9ddcbc0f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.137589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f4f7e-941f-46d4-a093-a07b9ddcbc0f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.145851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.146550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.146833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.147304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] PATH_INFO: `/v3/projects/5d32d8a616e94a0f80aa4ca28b0805f7/users/464032d99d274cb3a9fe028634b47935/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.171024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d32d8a616e94a0f80aa4ca28b0805f7, user_id=464032d99d274cb3a9fe028634b47935, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.174003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046504c-6f87-4da0-a36e-e44e35973c68 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.179745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] MFA Rules not processed for user `06756a5513104a68bca647da9e1b48a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:36.181212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:36.194191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 810/1603] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:36 2022] PUT /identity/v3/projects/5d32d8a616e94a0f80aa4ca28b0805f7/users/464032d99d274cb3a9fe028634b47935/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:36.195495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.195853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.196192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.230189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] MFA Rules not processed for user `44f446bb29f548e0bc392fead9b8bf49`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:36.231549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:36.313010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 794/1604] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:36.313010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.328480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afbf0d-0e4a-472a-b795-abbb4d21adec None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.344504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:36.374199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 811/1605] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:36.374594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.428736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:36.446396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.447130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.447729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.448091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.448956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.451874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.475026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 795/1606] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:36.476208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.491165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e29de2-d57b-4d2d-bb44-b1209297c8cc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.499013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.499890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.500458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.500952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] PATH_INFO: `/v3/projects/2d45ac15901c44e58c0263df459c350f/users/581c56d3c7e84cb4abb342b449d5fc53/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.504389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11dbbe9-47a5-4d50-b9b4-ad32f8a210f0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.509585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.510390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.511020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.511352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] PATH_INFO: `/v3/projects/24eb07d7a8f7432495673d1be4036687/users/f3095b1ac2464cf8b9302eea60ba2c4b/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.535703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24eb07d7a8f7432495673d1be4036687, user_id=f3095b1ac2464cf8b9302eea60ba2c4b, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.539065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4057-cfc2-4150-abf4-876d835b5043 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.549449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d45ac15901c44e58c0263df459c350f, user_id=581c56d3c7e84cb4abb342b449d5fc53, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.554750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea69c2-6bce-4ec7-8969-7867f8fc61d4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.558151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 812/1607] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:36 2022] PUT /identity/v3/projects/24eb07d7a8f7432495673d1be4036687/users/f3095b1ac2464cf8b9302eea60ba2c4b/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:36.559498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb4d1-d587-46f4-b123-61e282b258f0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.559789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb4d1-d587-46f4-b123-61e282b258f0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.560085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb4d1-d587-46f4-b123-61e282b258f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.581211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 796/1608] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:36 2022] PUT /identity/v3/projects/2d45ac15901c44e58c0263df459c350f/users/581c56d3c7e84cb4abb342b449d5fc53/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:36.584691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.585467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.585980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.617985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f8abb4d1-d587-46f4-b123-61e282b258f0 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:36.619611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f8abb4d1-d587-46f4-b123-61e282b258f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:36.621511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:36.623691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:36.737861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 797/1609] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:36.737861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.759916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 813/1610] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 23 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:36.761533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb45-8ca4-43dd-b2de-d1a1432dbd9c None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.761823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb45-8ca4-43dd-b2de-d1a1432dbd9c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.762101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447fb45-8ca4-43dd-b2de-d1a1432dbd9c None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.765109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 814/1611] 10.222.0.69 () {54 vars in 962 bytes} [Tue Aug 23 22:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:36.765883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fb45-8ca4-43dd-b2de-d1a1432dbd9c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:36.801709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447fb45-8ca4-43dd-b2de-d1a1432dbd9c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.807537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.811394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.811783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.812137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] PATH_INFO: `/v3/projects/eac7eb9d90e847178bb3d7c468d66932/users/4261aed041364d0c8326cab47c4ec247/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.854239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac7eb9d90e847178bb3d7c468d66932, user_id=4261aed041364d0c8326cab47c4ec247, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:36.857923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2ba94-02bd-4e1c-8500-e5f204388414 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:36.861041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd66c-b76a-48a0-a814-248325b389d8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:36.874503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:36.875185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.875554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.875856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.878016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 815/1612] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:36 2022] PUT /identity/v3/projects/eac7eb9d90e847178bb3d7c468d66932/users/4261aed041364d0c8326cab47c4ec247/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:36.879226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd00c-57cb-42bf-8afd-92a8276f7763 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:36.879674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd00c-57cb-42bf-8afd-92a8276f7763 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:36.879963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd00c-57cb-42bf-8afd-92a8276f7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:36.911688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1a9cd00c-57cb-42bf-8afd-92a8276f7763 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:36.913238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1a9cd00c-57cb-42bf-8afd-92a8276f7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:36.952369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:37.022469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 816/1613] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:37.022469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.022469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.022987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.035175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.036719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.049699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 798/1614] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.050928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.052549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:37.061420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:37.063557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:37.085462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 817/1615] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:37.092041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.114284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:37.220931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419e299-4fe0-481a-9d75-0d696f9f0bdb service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.329684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.330506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.331056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.331420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.351487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98766926-d9b0-4cdd-8529-589b1945ac09 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.358476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.360546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd1902-12e5-4d60-9c24-23ff0009f858 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.367908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.368678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.369214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.369677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.382787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 799/1616] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.384233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a836-20b0-405c-8305-cae7ae5801c6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.385757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a836-20b0-405c-8305-cae7ae5801c6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.386046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a836-20b0-405c-8305-cae7ae5801c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.432255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2c35a836-20b0-405c-8305-cae7ae5801c6 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:37.433741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2c35a836-20b0-405c-8305-cae7ae5801c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:37.457383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 800/1617] 10.222.0.69 () {58 vars in 1059 bytes} [Tue Aug 23 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:37.459155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.459533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.459880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.472402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.476653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.500614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 818/1618] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.500982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] MFA Rules not processed for user `4261aed041364d0c8326cab47c4ec247`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:37.502521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:37.504912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.525000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e888bd-8718-49af-b176-04afb5f3a0ee service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.537595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.538446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.538743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.539137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.571122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.573078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.597027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 819/1619] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.598482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 801/1620] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:37.599559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.604505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.614538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc97e47-bc99-4b33-b5ce-1e4d26611d34 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.625164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.625444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6bd00-3c93-40ad-8d3c-250c3481cb50 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.626103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.626430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.626878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.634778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.635436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.635816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.636127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.661008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.663530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.693816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 820/1621] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.694745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.707117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.709541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.714483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f54a-6158-4138-ba05-a7dba143800d service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.716593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:37.734798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 802/1622] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:37.738156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.738824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.739043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.739314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.739940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.747075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:37.816888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 821/1623] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:37 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:37.821286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:37.838103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c0fa9-a2f1-4b82-b61f-95eec963db2d service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:37.987205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:37.987846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:37.988910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:37.989197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:37.989986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:37.993033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.073536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 803/1624] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:37 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:38.078978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.095417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb400af-987f-4b75-9d59-16742c28d491 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.111300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.111300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.111300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.111300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.111943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.113638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbba22b-96a7-411a-b562-28abcac70160 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.159276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.159823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 822/1625] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:38.173793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef8a7-9323-47ba-a578-4e31d49bb638 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.193653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.195397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.195735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.196008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] PATH_INFO: `/v3/projects/b2d17025652e4fa29a075a3601bf3f67/users/82e849b7a7c149e6b1dc8f493c84c97c/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.242215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb317c8-b9b2-4214-ada1-04444d669c92 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.243066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb317c8-b9b2-4214-ada1-04444d669c92 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.243384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb317c8-b9b2-4214-ada1-04444d669c92 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.246119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 823/1626] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 23 22:23:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:38.249176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d17025652e4fa29a075a3601bf3f67, user_id=82e849b7a7c149e6b1dc8f493c84c97c, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.252781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f56b6-ffeb-4f19-8fe0-9a8e144879f2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.262462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed3dd-bb99-420c-82e8-9c4080d00bad None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.262750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed3dd-bb99-420c-82e8-9c4080d00bad None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.263050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ed3dd-bb99-420c-82e8-9c4080d00bad None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.266656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 824/1627] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 23 22:23:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:38.273811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.274195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.274532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.303938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:38.321918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 804/1628] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:38 2022] PUT /identity/v3/projects/b2d17025652e4fa29a075a3601bf3f67/users/82e849b7a7c149e6b1dc8f493c84c97c/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:38.328678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.331146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.331528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.366188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:38.367790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:38.434601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:38.438727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:38.593261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 825/1629] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:38.595133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.631900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 805/1630] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:38.634023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.730873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ebf15-64a9-4c4c-b142-90f7f228d2b9 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.740371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.741040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.741320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.741631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.742417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.745079 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.755361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43ab29-0df0-4e66-becd-31c80ad42429 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.769111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.769764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.770055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.770530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.770983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 826/1631] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:38.771926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.788601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c458c1-24ff-4fd0-850a-8c1b84d2c2f4 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.796767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.799643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.800250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.800594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.807106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.809736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.819929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.821772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b249fc9-e4e4-4a59-b987-c4395b50d9a6 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.823643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:38.838091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 806/1632] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:38.845162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 827/1633] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:38.853790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:38.908384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f026c1-da70-4eb5-997f-f00198129550 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:38.926604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:38.927616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.927938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.928214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] PATH_INFO: `/v3/projects/b2d17025652e4fa29a075a3601bf3f67/users/82e849b7a7c149e6b1dc8f493c84c97c/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.939070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d17025652e4fa29a075a3601bf3f67, user_id=82e849b7a7c149e6b1dc8f493c84c97c, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:38.941863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:38.966057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 807/1634] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:38 2022] PUT /identity/v3/projects/b2d17025652e4fa29a075a3601bf3f67/users/82e849b7a7c149e6b1dc8f493c84c97c/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:38.981355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.981705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.983567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:39.178254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] MFA Rules not processed for user `82e849b7a7c149e6b1dc8f493c84c97c`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:39.186709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:39.193110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:39.444901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310323-0046-4105-b123-17cf9af0292f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:39.482639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:39.483709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:39.484149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:39.484649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] PATH_INFO: `/v3/users/26fb71ec9dc74d898345bf60409d4132` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:39.498728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fb71ec9dc74d898345bf60409d4132)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:39.500729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: WARNING py.warnings [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:39.500729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: warnings.warn(msg) Aug 23 22:23:39.500729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: Aug 23 22:23:39.503060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:39.676977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 828/1635] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 696 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:39.701901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:39.712363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:39.848237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fb71ec9dc74d898345bf60409d4132'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:39.956905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fb71ec9dc74d898345bf60409d4132'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:40.005989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dc17e-25c1-4b40-925d-cf1f7d075e21 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:40.008960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fb71ec9dc74d898345bf60409d4132'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:40.014001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fb71ec9dc74d898345bf60409d4132'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:40.014404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-11f5d49e-69b9-4899-91b1-386fc810397d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fb71ec9dc74d898345bf60409d4132'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:40.019909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:40.022548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:40.024696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:40.025160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:40.035050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:40.068733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 808/1636] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:39 2022] DELETE /identity/v3/users/26fb71ec9dc74d898345bf60409d4132 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:23:40.077436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:40.077436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:40.077874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:40.086640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:40.094428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:40.169010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 829/1637] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:40.174472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:40.182370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:40.359026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 809/1638] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:40.456540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:40.458993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:40.490296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:40.491792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:40.509251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:40.642837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa6b3d-378b-4ea9-903d-c5c545b13538 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:40.651700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:40.653502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:40.654604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:40.655773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:40.662355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:40.827056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ae164-e5c3-4d72-bdd5-86b975d65f7f service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:40.842984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:40.846037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:40.895037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 810/1639] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:41.031777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:41.032843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:41.033352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:41.033841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:41.083430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:41.086792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6a96f-6f19-4846-8681-5a6bb696ed09 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:41.135890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 830/1640] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:44.191474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:44.192902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:44.221633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2609d-52cc-4726-bf07-bffb6cc98ef8 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:44.244644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:44.248202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:44.248202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:44.250056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] PATH_INFO: `/v3/projects/d12eee1d70624f5b8ce23d58abad3edd` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:44.252954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12eee1d70624f5b8ce23d58abad3edd)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:44.266094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:44.428898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12eee1d70624f5b8ce23d58abad3edd', 'request_id': 'req-f4724c33-00a9-455c-95f5-b09e206d9236'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:44.449521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12eee1d70624f5b8ce23d58abad3edd', 'request_id': 'req-f4724c33-00a9-455c-95f5-b09e206d9236'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:44.475528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12eee1d70624f5b8ce23d58abad3edd', 'request_id': 'req-f4724c33-00a9-455c-95f5-b09e206d9236'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:44.510438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] The token cache is being invalidate because project d12eee1d70624f5b8ce23d58abad3edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:44.510669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:44.511555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4724c33-00a9-455c-95f5-b09e206d9236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:44.520224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:44.520964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 811/1641] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:44 2022] DELETE /identity/v3/projects/d12eee1d70624f5b8ce23d58abad3edd => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:44.524209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:44.526124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:44.575925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:44.578206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:44.759450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 831/1642] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:44.762639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:44.763752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:44.764245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:44.817587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:44.818877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:44.852111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 812/1643] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:44.856587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:44.864606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:44.878073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac4ba-3750-4ac6-86e7-a9502fbf7d8d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:44.922427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:44.923150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:44.923509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:44.923861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:44.924651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:44.925119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:44.926971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:44.956321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:44.963413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 832/1644] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:44.969213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2258846-2bcd-4728-8bc5-ca17ad6f2078 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:44.987208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:44.987772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:44.988127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:44.988403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:44.989168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:44.991337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:45.063319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 813/1645] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:44 2022] POST /identity/v3/projects => generated 403 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:45.064535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:45.086068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16703e-8771-40db-8d18-39eee74a7182 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:45.385701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:45.387613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:45.387916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:45.408491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:45.408491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:45.408491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:45.490703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 833/1646] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:45 2022] POST /identity/v3/users => generated 302 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:23:45.494983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:45.518305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33286d2-22ff-497d-9f64-bdc34ce0cb03 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:45.539189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:45.539835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:45.540254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:45.541407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:45.541407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:45.543157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:45.583149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 814/1647] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:45.587341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:45.615547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6bea3-69e3-43b3-9ad9-840b3186781a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:45.625275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:45.626357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:45.627587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:45.628342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:45.630009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:45.634399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ce8cd-9a42-4697-93db-b86b98284dfe admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:45.678616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 834/1648] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:45.681535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:45.691457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:45.699972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c65b-ba4d-4cf2-8694-c988d07a227b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:45.715003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:45.716057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:45.717128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:45.717707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] PATH_INFO: `/v3/projects/56ed241deb04420893522c7213ba69e7/users/46ea29383ff54400afc646a5a2d91f72/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:45.807360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ed241deb04420893522c7213ba69e7, user_id=46ea29383ff54400afc646a5a2d91f72, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:45.811371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:45.840543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 815/1649] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:45 2022] PUT /identity/v3/projects/56ed241deb04420893522c7213ba69e7/users/46ea29383ff54400afc646a5a2d91f72/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:23:45.845870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:45.846327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:45.846728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:45.889918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:45.900161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:46.074814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 835/1650] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:46.145526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:46.150262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:46.336786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb1056-605c-4b0d-99af-59868b4c3cbc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:46.353531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:46.354181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:46.354468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:46.354745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:46.401213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:46.405733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a553178-9d5b-48a5-8918-0561b2233d8a service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:46.485245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 816/1651] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:46.707458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:46.710790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:46.792336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec9471-c622-4958-bbbc-2c9fbd5b5fce None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:46.811762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:46.812509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:46.812784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:46.815612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] PATH_INFO: `/v3/users/44f446bb29f548e0bc392fead9b8bf49` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:46.822633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f446bb29f548e0bc392fead9b8bf49)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:46.832762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:46.983691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f446bb29f548e0bc392fead9b8bf49'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:46.985587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f446bb29f548e0bc392fead9b8bf49'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:47.028071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f446bb29f548e0bc392fead9b8bf49'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:47.030118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f446bb29f548e0bc392fead9b8bf49'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:47.069003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f446bb29f548e0bc392fead9b8bf49'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:47.080736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:47.143304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 836/1652] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:46 2022] DELETE /identity/v3/users/44f446bb29f548e0bc392fead9b8bf49 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:47.145156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac53ea-a37d-4663-8c71-496472a2c982 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:47.146107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac53ea-a37d-4663-8c71-496472a2c982 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:47.146520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac53ea-a37d-4663-8c71-496472a2c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:47.198037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-00ac53ea-a37d-4663-8c71-496472a2c982 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:47.210164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-00ac53ea-a37d-4663-8c71-496472a2c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:47.365916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 817/1653] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:47.417158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:47.420615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:47.642911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4225-bcb4-47c9-a02d-06a60c6999f7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:47.657133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:47.657911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:47.658206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:47.659896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:47.692254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:47.694656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:47.727482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 837/1654] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:48.382865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:48.383444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:48.383444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:48.447937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] MFA Rules not processed for user `4cf5be327ff749ee901f5fb33ab9f6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:48.449213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:48.600227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 818/1655] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:48.616323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:48.619238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:48.800201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083571a6-f9cd-4a30-83f3-ec7c265ee312 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:48.819487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:48.820317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:48.820740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:48.821291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:48.838587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:48.845429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c05ba5-85f4-45b6-93b5-1b7ffef643bf service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:48.873643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 838/1656] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:49.471516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:49.473182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:49.505516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e4282-540f-4210-9438-d22060d3ea47 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:49.534969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:49.535952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:49.536533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:49.537031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] PATH_INFO: `/v3/projects/af3d0801b6ff4a79a0bd66f89e094d00` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:49.546738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3d0801b6ff4a79a0bd66f89e094d00)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:49.554725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:49.580003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:49.711484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3d0801b6ff4a79a0bd66f89e094d00', 'request_id': 'req-14bfba28-90da-4f81-bb5f-736cba551ce8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:49.730479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3d0801b6ff4a79a0bd66f89e094d00', 'request_id': 'req-14bfba28-90da-4f81-bb5f-736cba551ce8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:49.754321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3d0801b6ff4a79a0bd66f89e094d00', 'request_id': 'req-14bfba28-90da-4f81-bb5f-736cba551ce8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:49.786644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] The token cache is being invalidate because project af3d0801b6ff4a79a0bd66f89e094d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:49.787382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:49.789223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-14bfba28-90da-4f81-bb5f-736cba551ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:49.797972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 819/1657] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:49 2022] DELETE /identity/v3/projects/af3d0801b6ff4a79a0bd66f89e094d00 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:49.799613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f32d6-4127-4c41-ab8b-367c987e2f3c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:49.799913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f32d6-4127-4c41-ab8b-367c987e2f3c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:49.800192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f32d6-4127-4c41-ab8b-367c987e2f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:49.847807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-613f32d6-4127-4c41-ab8b-367c987e2f3c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:49.849243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-613f32d6-4127-4c41-ab8b-367c987e2f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:50.021346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 839/1658] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:50.033686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.034292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.034776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.046177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.046454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.046908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.083797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:50.085402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:50.100870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 820/1659] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:50.105132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.109444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:50.120023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34eff52-7dd6-405c-9278-3de75b8795d1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.130663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.131672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.133914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.134740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.135556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] MFA Rules not processed for user `46ea29383ff54400afc646a5a2d91f72`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:50.135939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:50.136762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.137498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:50.145236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.174925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 821/1660] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:50.182975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.204769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a3c2-9f7f-41a8-b793-d0717d86f3b5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.215503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.217163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.218502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.219037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.220690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.223590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.280508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 822/1661] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:50.282084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.356956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 840/1662] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:50.358117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.359581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:50.392690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d5f6e-52b3-431a-bcf9-863c4d8afef6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.441913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0904f3-5afd-4fc3-8d97-c974b5d1f008 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.455581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.456396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.456685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.457898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.458597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.461106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.510506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 823/1663] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:50.511132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.511132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.511132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.511132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.513407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.513969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.521853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.543871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c25f5e-ef43-4ae5-a83c-49d5b881a813 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.566922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.567751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.568179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.568594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.569458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.571493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.597267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 824/1664] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:50.601411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.614602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 841/1665] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/projects => generated 405 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:50.615731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.620524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d7290-d1cf-4a16-9cef-b4b53da4e72f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.720377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:50.796799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a6c87-e07b-4c24-9ab0-d0301764987b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.819839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.826136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.826884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.827226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.828031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.831127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.833526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.834499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.834882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.836001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.838626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.847537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.879614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 842/1666] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:50 2022] POST /identity/v3/users => generated 309 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:23:50.884678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.903071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 825/1667] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:50.909167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.910169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff82f0-fdef-42e6-b3fa-281594218943 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.928041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.929091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.929532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.929949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.930743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.932541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:50.950067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccff00-75b6-4df8-a807-2451ff2c7a60 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.956303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 843/1668] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:50.957861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:50.958836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:50.959378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:50.959743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] PATH_INFO: `/v3/projects/ab50785b39e0421d851fa8ffb2903e69/users/28daf04887b34315a308ba74e39762b2/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:50.960864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:50.979145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:50.984918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3e71-24a0-42dc-8c48-b6582f795122 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:50.992021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab50785b39e0421d851fa8ffb2903e69, user_id=28daf04887b34315a308ba74e39762b2, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:50.996130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c64226-0106-4068-bed2-31e26c11b5cf admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.005748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.006732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.007151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.007573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] PATH_INFO: `/v3/projects/25d268849f2c49b984fb99a420a502f2/users/227fbd3c74ac471e890720d4df12a0c6/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.034657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 826/1669] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:50 2022] PUT /identity/v3/projects/ab50785b39e0421d851fa8ffb2903e69/users/28daf04887b34315a308ba74e39762b2/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:51.040992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d268849f2c49b984fb99a420a502f2, user_id=227fbd3c74ac471e890720d4df12a0c6, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.042685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.043044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.043329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.044856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.077823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 844/1670] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:50 2022] PUT /identity/v3/projects/25d268849f2c49b984fb99a420a502f2/users/227fbd3c74ac471e890720d4df12a0c6/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:51.079101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.089781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.117080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] MFA Rules not processed for user `28daf04887b34315a308ba74e39762b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:51.118452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.239282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b5b4f-faac-4c0a-b044-58fe60fe455a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.254917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.255783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.256208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.256586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] PATH_INFO: `/v3/users/4261aed041364d0c8326cab47c4ec247` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.257963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4261aed041364d0c8326cab47c4ec247)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.260190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.316678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 827/1671] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:51.317875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.353051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfb68a-8070-4d04-add1-3848b9c6e0c2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.377970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.378614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.378898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.379172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.379847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.381534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.384136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4261aed041364d0c8326cab47c4ec247'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:51.384768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4261aed041364d0c8326cab47c4ec247'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:51.401978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4261aed041364d0c8326cab47c4ec247'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:51.407945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4261aed041364d0c8326cab47c4ec247'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:51.415162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 828/1672] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:51.416607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.418412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4261aed041364d0c8326cab47c4ec247'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:51.432506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.453851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7b3c7-da35-4d5d-a852-0bf1bad3729e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.463332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 845/1673] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:51 2022] DELETE /identity/v3/users/4261aed041364d0c8326cab47c4ec247 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:51.463989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.464230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.465110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.465936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.467921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.469635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.472704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8bfdf-28ea-42c6-a661-3ffe975549d2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.478559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.518553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 829/1674] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:51 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:51.521541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.522080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.522586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.559395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:51.563242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.613060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d5f78-8c19-4c94-b5be-78fb8a7f11ee admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.631888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:51.697386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 830/1675] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:51.699711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.715619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:51.732962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f49a59-24ba-45bd-8ac9-6f6340d6cd0b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.749785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.751982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.752330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.752614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.756398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.761438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.765578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.766287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.766570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.766959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] PATH_INFO: `/v3/projects/25d268849f2c49b984fb99a420a502f2/users/227fbd3c74ac471e890720d4df12a0c6/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:51.774577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d268849f2c49b984fb99a420a502f2, user_id=227fbd3c74ac471e890720d4df12a0c6, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:51.777541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:51.805349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 846/1676] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:51 2022] PUT /identity/v3/projects/25d268849f2c49b984fb99a420a502f2/users/227fbd3c74ac471e890720d4df12a0c6/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:51.805349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.814444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.817567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 831/1677] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:51 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:51.818830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:51.826368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:51.863033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfe477-fb93-4731-81df-962e5369b710 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.946338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4727f5-f6ff-4429-afb5-f9cad8272179 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:51.951638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:51.952305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:51.952582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:51.952888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.032739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:52.034120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.034587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.035051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] PATH_INFO: `/v3/users/06756a5513104a68bca647da9e1b48a7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.036750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06756a5513104a68bca647da9e1b48a7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.040539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.090148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.092757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.119650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 847/1678] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:52.120199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:52.141480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa664f7-2776-4a87-8b03-d1f6fed709be service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:52.160927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:52.161410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.161692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.161977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.162621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.165058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.191391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 848/1679] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:52.192145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:52.199491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06756a5513104a68bca647da9e1b48a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:52.211230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce4ec3-9805-4d34-847d-a4b17ed5e390 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:52.229668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:52.230362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.230690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.230984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] PATH_INFO: `/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6/users/cffb6d815cba423bb9f130e570a7e6a4/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.232630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06756a5513104a68bca647da9e1b48a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:52.262316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0d264ef26c47ae9ca7bc57c03076a6, user_id=cffb6d815cba423bb9f130e570a7e6a4, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.267218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.268070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06756a5513104a68bca647da9e1b48a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:52.274470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06756a5513104a68bca647da9e1b48a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:52.276669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-92c3f832-71f4-4da5-adfa-7df583407ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06756a5513104a68bca647da9e1b48a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:52.304945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 849/1680] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:52 2022] PUT /identity/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6/users/cffb6d815cba423bb9f130e570a7e6a4/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:23:52.306185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:52.314059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:52.314800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 832/1681] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:51 2022] DELETE /identity/v3/users/06756a5513104a68bca647da9e1b48a7 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:52.316881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.317340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.322995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.354595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:52.379922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:52.385220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:52.478602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c39ddc-c5b1-4927-ba28-bb553854f4cd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:52.584515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 833/1682] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:52.617315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:52.618055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.618335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.618608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.619443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.623552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.639174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:52.642395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:52.657189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:52.657825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 850/1683] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:52.659004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:52.691120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6f37f-aa46-4f8c-b8c9-4157b247b71d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:52.718034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:52.718828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.719151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.719516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] PATH_INFO: `/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6/users/cffb6d815cba423bb9f130e570a7e6a4/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.726810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b0d264ef26c47ae9ca7bc57c03076a6, user_id=cffb6d815cba423bb9f130e570a7e6a4, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:52.735012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44418c-f3f1-43bc-9d93-80876de33a60 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:52.772004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 851/1684] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:52 2022] PUT /identity/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6/users/cffb6d815cba423bb9f130e570a7e6a4/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:52.773780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:52.774183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:52.774622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:52.866630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] MFA Rules not processed for user `cffb6d815cba423bb9f130e570a7e6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:52.871485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:52.933295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6f7e0-fdce-46b5-8e40-8124be983db2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:53.156855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 852/1685] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:53.171595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:53.187127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:53.215256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:53.216954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:53.217635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:53.220095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:53.315983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:53.411570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a9814-06c2-41fa-981b-b9d691134b04 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:53.413929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:53.415780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a3717-24f9-425e-ac32-6b7b007d28fc service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:53.430594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:53.435533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:53.435945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:53.436219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:53.441042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 834/1686] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:53.481191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:53.486249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:53.517403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 853/1687] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:54.798568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:54.799059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:54.800496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:54.866334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] MFA Rules not processed for user `f3095b1ac2464cf8b9302eea60ba2c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:54.867701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.170113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:55.171866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.177507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:55.192708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 835/1688] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:55.201240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:55.202892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.209161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b9f2fb-328d-424c-b664-243480e1f070 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:55.232204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:55.233070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:55.233196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:55.233522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] PATH_INFO: `/v3/projects/eac7eb9d90e847178bb3d7c468d66932` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:55.241343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac7eb9d90e847178bb3d7c468d66932)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:55.248425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: WARNING py.warnings [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:23:55.248425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: warnings.warn(msg) Aug 23 22:23:55.248425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: Aug 23 22:23:55.253692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:55.446877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677a1e8-a817-4e5a-aab2-5a89628d946c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:55.470343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac7eb9d90e847178bb3d7c468d66932', 'request_id': 'req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:55.498458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac7eb9d90e847178bb3d7c468d66932', 'request_id': 'req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:55.554108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac7eb9d90e847178bb3d7c468d66932', 'request_id': 'req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:55.608520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] The token cache is being invalidate because project eac7eb9d90e847178bb3d7c468d66932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:55.608985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:55.609928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c0ea40e6-f23c-4900-ab82-3c0c0fafc2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:55.614018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 854/1689] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:55 2022] DELETE /identity/v3/projects/eac7eb9d90e847178bb3d7c468d66932 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:23:55.615766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:55.617294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:55.617700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:55.731103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:55.732668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:55.733190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:55.733611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:55.736163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.745290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] MFA Rules not processed for user `4cf5be327ff749ee901f5fb33ab9f6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:55.754992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.892325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:55.899419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:55.927255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 855/1690] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:55.927255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:55.947563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:55.954814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 836/1691] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:55.957741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:55.961022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:56.108952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:56.158956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431370-b823-4651-879a-e70567f6eea0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:56.172884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:56.174362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.175081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.175081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] PATH_INFO: `/v3/users/82e849b7a7c149e6b1dc8f493c84c97c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.178086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e849b7a7c149e6b1dc8f493c84c97c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:56.182130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:56.187088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:56.199496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd3106-6fab-4b3c-bb73-c5e3c7cf496c service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:56.213203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:56.216868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.217313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.218790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] PATH_INFO: `/v3/projects/61fb584763c54c339f391cbfc3e90045` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.221793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61fb584763c54c339f391cbfc3e90045)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:56.227487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:56.343907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e849b7a7c149e6b1dc8f493c84c97c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.346367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e849b7a7c149e6b1dc8f493c84c97c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.375410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e849b7a7c149e6b1dc8f493c84c97c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.376047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e849b7a7c149e6b1dc8f493c84c97c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.411271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6ded4234-1374-4b67-b6e3-f64c798c8384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e849b7a7c149e6b1dc8f493c84c97c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.433729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61fb584763c54c339f391cbfc3e90045', 'request_id': 'req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.454174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61fb584763c54c339f391cbfc3e90045', 'request_id': 'req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.464329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61fb584763c54c339f391cbfc3e90045', 'request_id': 'req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.509300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 856/1692] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:55 2022] DELETE /identity/v3/users/82e849b7a7c149e6b1dc8f493c84c97c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:56.515095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] The token cache is being invalidate because project 61fb584763c54c339f391cbfc3e90045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:56.518580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.520691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:56.525592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 837/1693] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:55 2022] DELETE /identity/v3/projects/61fb584763c54c339f391cbfc3e90045 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:56.532540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a512e95-e4fa-472b-8ca4-977af8ca9a11 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.533043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a512e95-e4fa-472b-8ca4-977af8ca9a11 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.533500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a512e95-e4fa-472b-8ca4-977af8ca9a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.611210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3a512e95-e4fa-472b-8ca4-977af8ca9a11 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:56.613823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3a512e95-e4fa-472b-8ca4-977af8ca9a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:56.791704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:56.793381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:56.818136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 857/1694] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:56.826959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.827476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.828014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.862072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:56.865875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:56.890286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 858/1695] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:56.891381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:56.906007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7852e-b712-4830-abbe-3fa4fdb86f3b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:56.920021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:56.920021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.920369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.920619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.921325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:56.921623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:56.926013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:56.944500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6bb25-e4ac-4412-9b08-d9f184ed2b13 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:56.954468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 859/1696] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:56.955506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:56.957350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:56.958027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:56.958309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:56.958582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] PATH_INFO: `/v3/users/28daf04887b34315a308ba74e39762b2` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:56.964836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28daf04887b34315a308ba74e39762b2)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:56.971945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:56.993212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12483-325e-4234-bcb5-1f12a3848050 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.014385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.014385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.014385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.014385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.014713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:57.017233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca303-597e-44ef-b91c-0995c0489919 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:57.100364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 860/1697] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:56 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:57.104291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e621ae-d798-4332-9330-8355d5ed2a8e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.108759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e621ae-d798-4332-9330-8355d5ed2a8e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.109368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e621ae-d798-4332-9330-8355d5ed2a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.145803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28daf04887b34315a308ba74e39762b2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:57.180558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-61e621ae-d798-4332-9330-8355d5ed2a8e None None] MFA Rules not processed for user `464032d99d274cb3a9fe028634b47935`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:57.181849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-61e621ae-d798-4332-9330-8355d5ed2a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.189811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28daf04887b34315a308ba74e39762b2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:57.193280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:57.211300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28daf04887b34315a308ba74e39762b2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:57.213145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28daf04887b34315a308ba74e39762b2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:57.213878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28daf04887b34315a308ba74e39762b2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:57.245218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 838/1698] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:23:56 2022] DELETE /identity/v3/users/28daf04887b34315a308ba74e39762b2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:23:57.249862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:57.257025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.271358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:57.387523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 861/1699] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:57.390093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b27715-418c-487b-9cef-159e7f2121db None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.390516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b27715-418c-487b-9cef-159e7f2121db None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.390792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b27715-418c-487b-9cef-159e7f2121db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.435142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335e7f3-ae2f-40e4-8faa-baf785a5408d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.445638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f9b27715-418c-487b-9cef-159e7f2121db None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:57.446899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f9b27715-418c-487b-9cef-159e7f2121db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.449808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.451200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.452890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.454949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.455690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:57.460651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 862/1700] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:57.462203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.462593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.464121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcac0de-c4f1-48f3-ba62-38616506d133 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:57.464253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.506933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] MFA Rules not processed for user `227fbd3c74ac471e890720d4df12a0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:57.508366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.513202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 839/1701] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/users => generated 282 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:57.515493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.515877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.516155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.564694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] MFA Rules not processed for user `464032d99d274cb3a9fe028634b47935`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:57.566083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.617313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 863/1702] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:57.619021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:57.620923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.696421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecaf1b-f332-4dc2-9451-575bc8b33775 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.703007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.703838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.704192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.704536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.720003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:57.721874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca820-f5e2-4127-80fa-eef847b9f9bb service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:57.726498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 840/1703] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:57.727570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:57.736655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 864/1704] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:57.739170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.739643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.740066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.748558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 865/1705] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 23 22:23:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:57.749879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:57.752134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.753525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880437-1784-4e63-9ae4-d617524b6cab None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.774899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.775629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.775987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.776322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.777128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:57.779438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405433e-8bcc-41a5-a983-f41ee1539ebc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:57.804077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 841/1706] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:57.805658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.806000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.806348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.832522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:57.865622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac983-7638-46ac-9b7a-1be73417e367 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.876454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.877432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.877712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.880127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.902519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:57.904836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:57.938700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:57.940370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:57.945691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 866/1707] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:57.947433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:57.955659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 842/1708] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:23:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:57.976412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb02fd-c17e-4eca-a9c4-8d9cb178a283 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:57.991504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:57.992557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:57.992861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:57.993564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:57.994599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:58.001129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:58.028542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 867/1709] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:58.033624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:58.055541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff7b62-6ba3-4387-b7ee-198b5abc9800 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:58.064164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:58.065969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:58.069415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:58.070368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.070713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.071002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] PATH_INFO: `/v3/projects/e5d1f458e6f64165b55590ab5041bbe8/users/a2197c8fa48c46508bb06ae5ebde6cb5/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.089113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da29a5-80e2-4311-b676-d9e4680f5b69 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:58.113949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:58.114158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d1f458e6f64165b55590ab5041bbe8, user_id=a2197c8fa48c46508bb06ae5ebde6cb5, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:58.114240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.114525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.114802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.124389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:58.139739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:58.143776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951479e-ccda-43cd-94a8-5550feae92a0 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:58.157453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 868/1710] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:23:58.158110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 843/1711] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:58 2022] PUT /identity/v3/projects/e5d1f458e6f64165b55590ab5041bbe8/users/a2197c8fa48c46508bb06ae5ebde6cb5/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:58.173397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.173791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.174018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.270718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] MFA Rules not processed for user `a2197c8fa48c46508bb06ae5ebde6cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:58.273127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:58.478736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 869/1712] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:23:58.483374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:58.555001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:58.642179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571bb90-b776-4c6b-9ae6-6bd34c861d65 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:58.656530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:58.657938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.659250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.660592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.663885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:58.667684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:58.676182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:58.679231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:58.710863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf22ce9-0ea6-4b54-a1b0-465d63d4e918 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:58.756846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:58.760414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.760780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.761813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] PATH_INFO: `/v3/projects/b2d17025652e4fa29a075a3601bf3f67` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.771988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d17025652e4fa29a075a3601bf3f67)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:58.780512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:58.791920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 844/1713] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:58 2022] POST /identity/v3/projects => generated 363 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:58.796793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:58.905474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d17025652e4fa29a075a3601bf3f67', 'request_id': 'req-3d0e2b7f-b566-44e4-9a22-de5404915b1d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:58.920553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d17025652e4fa29a075a3601bf3f67', 'request_id': 'req-3d0e2b7f-b566-44e4-9a22-de5404915b1d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:58.928887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d17025652e4fa29a075a3601bf3f67', 'request_id': 'req-3d0e2b7f-b566-44e4-9a22-de5404915b1d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:58.942921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310a44-1889-42dd-b397-846ab9a22cd4 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:58.969969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] The token cache is being invalidate because project b2d17025652e4fa29a075a3601bf3f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:23:58.970423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:58.973891 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3d0e2b7f-b566-44e4-9a22-de5404915b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:23:58.981104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 870/1714] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:23:58 2022] DELETE /identity/v3/projects/b2d17025652e4fa29a075a3601bf3f67 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:58.983807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba0a6-3d6d-4438-879f-ca5642023014 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:58.987369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba0a6-3d6d-4438-879f-ca5642023014 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:58.987868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ba0a6-3d6d-4438-879f-ca5642023014 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:58.995467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 871/1715] 10.222.0.69 () {54 vars in 912 bytes} [Tue Aug 23 22:23:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:58.997129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.001272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.002708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.060419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:59.064241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:59.102085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.102880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.103291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.103684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.104428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.110500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f49d8-a9e3-469e-b249-d0a194042ffe admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.128673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:59.183225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 845/1716] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:23:58 2022] POST /identity/v3/users => generated 288 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:23:59.186989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.187363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.188697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.254706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 872/1717] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:59.256774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.261765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:59.277330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:59.279165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:59.304206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870305-c216-4985-8ba1-7f9ab89933ff None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.334830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.335473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.335766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.336045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.336712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.344173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8680a-0346-4acb-810c-40a18fcdc89f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.389330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 873/1718] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:59.390873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.391171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.391452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.469702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:59.471166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:59.479382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:59.491359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 874/1719] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:59.493635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.520374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde11286-e051-4aff-903e-e0f4f254ea32 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.523640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 846/1720] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:59.524736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.534543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.535255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.535615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.535888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] PATH_INFO: `/v3/projects/6b8c2ffa40db49f4afdb114e15be4133/users/9d5164361b93457ca787fc9ab1a4a5e3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.558639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12436b2f-d823-403b-aaed-1f19a3ca0c65 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.582844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8c2ffa40db49f4afdb114e15be4133, user_id=9d5164361b93457ca787fc9ab1a4a5e3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.593572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.594298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.594577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.597741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac96ab-02ad-4de5-8723-2c5f6153003f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.600317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.601681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:23:59.601681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.608398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.623420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 875/1721] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:23:59 2022] PUT /identity/v3/projects/6b8c2ffa40db49f4afdb114e15be4133/users/9d5164361b93457ca787fc9ab1a4a5e3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:23:59.623420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.625983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.627531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.629150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 876/1722] 10.222.0.69 () {54 vars in 961 bytes} [Tue Aug 23 22:23:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:23:59.633353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.639784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:59.653021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 847/1723] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:23:59.653021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.673323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad980-1ad7-4bd7-a801-571464704bb0 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.805668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d3eb9-05a5-429d-944a-c375038a09a3 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.819077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.820357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.820634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.820940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.830539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.830929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.831216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.831863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.832537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.834200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.842780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.844321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160ae3f-8c50-4af7-aae0-23787d4cac44 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.865295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 877/1724] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:59.865462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 848/1725] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:23:59.866181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:59.867045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.867332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.867608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.905690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcebea-2ada-4e82-840c-3a6c25350f22 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:59.926457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:59.927680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:59.930133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:59.933231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:59.934078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:59.941997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:59.948850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:59.958652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:00.033312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 849/1726] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:23:59 2022] POST /identity/v3/projects => generated 355 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:00.034874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.175876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 878/1727] 10.222.0.69 () {58 vars in 1058 bytes} [Tue Aug 23 22:23:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:00.177147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.203705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8723-b16f-411f-96dd-c3fdc6b0e531 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.241245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b3fa5-e3b0-4e94-9b7e-d0da86adae6b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.252279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:00.266616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.267767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.268054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.268335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] PATH_INFO: `/v3/projects/6b8c2ffa40db49f4afdb114e15be4133/users/9d5164361b93457ca787fc9ab1a4a5e3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.276250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8c2ffa40db49f4afdb114e15be4133, user_id=9d5164361b93457ca787fc9ab1a4a5e3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.280179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.297053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 850/1728] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:00 2022] PUT /identity/v3/projects/6b8c2ffa40db49f4afdb114e15be4133/users/9d5164361b93457ca787fc9ab1a4a5e3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:00.308725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.374795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.375772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.376142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.376618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.377309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.379940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e1c64-dc7b-4b86-bc17-690987cfebb2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.442642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 879/1729] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:00 2022] POST /identity/v3/users => generated 278 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:00.444080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.444466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.444748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.464032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:00.499241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] MFA Rules not processed for user `9d5164361b93457ca787fc9ab1a4a5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:00.500664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:00.515659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15330db-b4df-4919-9b76-a795eab6543f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.553129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.554114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.554566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.554990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.572458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:00.608659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.610519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.638952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 880/1730] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:00.640355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.649447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 851/1731] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:00.650469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.656307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:00.746588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02705ea8-489f-4800-bb4c-ce69201934e8 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.760204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.763072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.764003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.764754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.765975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.769341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.816559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 881/1732] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:00.824221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.868802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa127b-c17b-4de3-a28a-25f3f915e79d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.900627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.905630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.905992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.906269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.906963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a7b8-2136-434a-88bf-c76a3d53d91b service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.908863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.910824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.912455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.913342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.913766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.914620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.936023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 882/1733] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:00.937482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:00.954282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.954946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bda490-b2bc-41df-9995-97fb03b302f1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:00.956951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e480f8c-4e65-486c-a2ae-92d5b2764cd7 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.960700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:00.961473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:00.961758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:00.962032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] PATH_INFO: `/v3/projects/3930a77e8a704b0e8bb2287d20415fdf/users/03b5bf15e03d47bb888e4c1bee8ee6a0/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:00.971279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 852/1734] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:00.983216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3930a77e8a704b0e8bb2287d20415fdf, user_id=03b5bf15e03d47bb888e4c1bee8ee6a0, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:00.986928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:00.997915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:01.020258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 883/1735] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:00 2022] PUT /identity/v3/projects/3930a77e8a704b0e8bb2287d20415fdf/users/03b5bf15e03d47bb888e4c1bee8ee6a0/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:01.022455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:01.022742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:01.023074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:01.142712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] MFA Rules not processed for user `03b5bf15e03d47bb888e4c1bee8ee6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:01.148188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:01.166291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:01.168105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:01.550472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f77d54-4cee-4373-be43-2d331afda715 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:01.554063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 853/1736] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:01.561899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:01.570582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:01.571539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:01.577065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:01.577065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] PATH_INFO: `/v3/projects/ab50785b39e0421d851fa8ffb2903e69` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:01.585089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab50785b39e0421d851fa8ffb2903e69)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:01.590712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:01.596378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bb3d7-8cf9-4ad5-8e86-6df6fff6c2b7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:01.613766 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:01.615637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:01.629805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:01.629984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:01.631208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:01.635992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35837d9-a020-4d0f-9c5a-bcad2c8c0d89 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:01.701513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 854/1737] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:01 2022] POST /identity/v3/projects => generated 357 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:01.704557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94f1c-184a-4292-8d2a-898ec2575113 None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:01.705084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94f1c-184a-4292-8d2a-898ec2575113 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:01.705562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc94f1c-184a-4292-8d2a-898ec2575113 None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:01.707983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 855/1738] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:24:01.709693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94f1c-184a-4292-8d2a-898ec2575113 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:01.852309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:01.859118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab50785b39e0421d851fa8ffb2903e69', 'request_id': 'req-005a1207-0f10-46b7-b40f-89c1e38f9bc1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:01.873699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc94f1c-184a-4292-8d2a-898ec2575113 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:01.876985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab50785b39e0421d851fa8ffb2903e69', 'request_id': 'req-005a1207-0f10-46b7-b40f-89c1e38f9bc1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:01.889817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab50785b39e0421d851fa8ffb2903e69', 'request_id': 'req-005a1207-0f10-46b7-b40f-89c1e38f9bc1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:01.920959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] The token cache is being invalidate because project ab50785b39e0421d851fa8ffb2903e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:01.921264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:01.926080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-005a1207-0f10-46b7-b40f-89c1e38f9bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:01.928353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 884/1739] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:01 2022] DELETE /identity/v3/projects/ab50785b39e0421d851fa8ffb2903e69 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:01.929754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:01.930191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:01.930475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.034820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:02.037129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.250709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:02.251357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:02.251730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:02.252008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.252658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:02.254818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3305b3a-69e3-447b-be87-da84abd0cdcd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:02.268691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 885/1740] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:24:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:02.275831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:02.284856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.317049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f655-b79e-4d40-aaaa-3a456863ad26 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:02.321610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 856/1741] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:01 2022] POST /identity/v3/users => generated 285 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:02.325306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30dde6-2140-4559-a411-b08fef8909a0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:02.326353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30dde6-2140-4559-a411-b08fef8909a0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:02.326686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30dde6-2140-4559-a411-b08fef8909a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.337280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:02.337948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:02.338230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:02.338517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] PATH_INFO: `/v3/users/cffb6d815cba423bb9f130e570a7e6a4` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.339724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffb6d815cba423bb9f130e570a7e6a4)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:02.342519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:02.378569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ba30dde6-2140-4559-a411-b08fef8909a0 None None] MFA Rules not processed for user `464032d99d274cb3a9fe028634b47935`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:02.379820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ba30dde6-2140-4559-a411-b08fef8909a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.400540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:02.455325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffb6d815cba423bb9f130e570a7e6a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:02.456198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffb6d815cba423bb9f130e570a7e6a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:02.472428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffb6d815cba423bb9f130e570a7e6a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:02.473824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffb6d815cba423bb9f130e570a7e6a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:02.495007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffb6d815cba423bb9f130e570a7e6a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:02.549861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 857/1742] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:02.564734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 886/1743] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:02 2022] DELETE /identity/v3/users/cffb6d815cba423bb9f130e570a7e6a4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:02.566476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:02.568489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.570843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:02.570843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:02.570843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.709659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] MFA Rules not processed for user `581c56d3c7e84cb4abb342b449d5fc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:02.721813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.751909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93edc2-808e-4a5b-93da-beccb30eb115 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:02.761546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:02.762310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:02.764277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:02.764613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:02.770033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.815865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:02.817715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:02.864024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 887/1744] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:02.865456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:02.871807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:02.941147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 858/1745] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:02.946328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:02.948598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.021120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:03.145417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43c2f3-b3cc-4dba-b395-8643ee007191 service placement] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:03.183074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:03.185838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.186894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.187285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.189508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:03.205289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f79d6-3b71-4ded-8dd9-6536d731debc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:03.208547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb65580-2684-4865-a2af-e4ce61350ff4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:03.228295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:03.229062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.229401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.229686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] PATH_INFO: `/v3/users/a2197c8fa48c46508bb06ae5ebde6cb5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.236690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2197c8fa48c46508bb06ae5ebde6cb5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:03.239025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:03.242814 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 888/1746] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:03.248655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e37b-1f0d-4d0a-81cc-ed56f1d1a70e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.251014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e37b-1f0d-4d0a-81cc-ed56f1d1a70e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.252540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e37b-1f0d-4d0a-81cc-ed56f1d1a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.322952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8927e37b-1f0d-4d0a-81cc-ed56f1d1a70e None None] MFA Rules not processed for user `581c56d3c7e84cb4abb342b449d5fc53`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:03.323160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8927e37b-1f0d-4d0a-81cc-ed56f1d1a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.361667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 889/1747] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:03.375477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.375837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.377190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.386431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2197c8fa48c46508bb06ae5ebde6cb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:03.435896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2197c8fa48c46508bb06ae5ebde6cb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:03.446971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] MFA Rules not processed for user `f3095b1ac2464cf8b9302eea60ba2c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:03.455357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.458311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2197c8fa48c46508bb06ae5ebde6cb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:03.459259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2197c8fa48c46508bb06ae5ebde6cb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:03.461032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2197c8fa48c46508bb06ae5ebde6cb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:03.490720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:03.506602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 859/1748] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:02 2022] DELETE /identity/v3/users/a2197c8fa48c46508bb06ae5ebde6cb5 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:03.509982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:03.511651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.632880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 890/1749] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:03.632880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:03.640644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.710861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e3e25-6cbe-4880-a893-5f2a3d0bdfb7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:03.728106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:03.729308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.729878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.730308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] PATH_INFO: `/v3/projects/5d8ba88b4e044f049df758ff18e24b20/users/c49d9711357248a787955e933f71451c/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.771988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8ba88b4e044f049df758ff18e24b20, user_id=c49d9711357248a787955e933f71451c, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:03.775443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54833675-a110-4555-bdd6-01bff90811bd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:03.818500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 860/1750] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:03 2022] PUT /identity/v3/projects/5d8ba88b4e044f049df758ff18e24b20/users/c49d9711357248a787955e933f71451c/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:03.820333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:03.830432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:03.834347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:03.862229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c71304-5cec-4f83-bf3b-3ba6c27eb116 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:03.873926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:03.876778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:03.929132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:04.029021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.031301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.036412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.036991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.038021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 861/1751] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:04.039586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:04.047768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.081883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742cb6-5f15-4c24-a02b-d4d084207a37 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:04.103570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.104844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.106001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.106385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.110085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.117613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:04.142183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 862/1752] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:04.144000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:04.147519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.214857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:04.223191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.225244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:04.246747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 891/1753] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:04.248784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:04.258674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.269632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17337ea5-0553-41ea-b8dd-afdd84fa8d2f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:04.279299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.280104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.280459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.280865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.305263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef01b2-940d-4a55-ba2c-c62758b69187 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:04.305660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.307292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:04.312269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.312985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.313271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.313557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] PATH_INFO: `/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.314785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b0d264ef26c47ae9ca7bc57c03076a6)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.317295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:04.337901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 863/1754] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:04.338911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:04.360663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb56a5-7699-4600-9e8e-97697ad075d8 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:04.371539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.412597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.413655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.413950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] PATH_INFO: `/v3/projects/5d8ba88b4e044f049df758ff18e24b20/users/c49d9711357248a787955e933f71451c/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.438393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8ba88b4e044f049df758ff18e24b20, user_id=c49d9711357248a787955e933f71451c, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.450906 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b0d264ef26c47ae9ca7bc57c03076a6', 'request_id': 'req-895417d3-acc1-4412-b47f-39adf6d2b06c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:04.459533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:04.488048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b0d264ef26c47ae9ca7bc57c03076a6', 'request_id': 'req-895417d3-acc1-4412-b47f-39adf6d2b06c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:04.500708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b0d264ef26c47ae9ca7bc57c03076a6', 'request_id': 'req-895417d3-acc1-4412-b47f-39adf6d2b06c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:04.521400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] The token cache is being invalidate because project 3b0d264ef26c47ae9ca7bc57c03076a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:04.522014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:04.523411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-895417d3-acc1-4412-b47f-39adf6d2b06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:04.523555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 864/1755] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:04 2022] PUT /identity/v3/projects/5d8ba88b4e044f049df758ff18e24b20/users/c49d9711357248a787955e933f71451c/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:04.525749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:04.529247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 892/1756] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:04 2022] DELETE /identity/v3/projects/3b0d264ef26c47ae9ca7bc57c03076a6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:04.533585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.535771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36284-ddb7-4482-87c5-e58a2124f155 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.537206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36284-ddb7-4482-87c5-e58a2124f155 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.539265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e36284-ddb7-4482-87c5-e58a2124f155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.598943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-46e36284-ddb7-4482-87c5-e58a2124f155 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:04.600999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-46e36284-ddb7-4482-87c5-e58a2124f155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.732491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 893/1757] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:04.736228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.737060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.737587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.845858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85c73-6fec-48cd-85fa-64c02d037efc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:04.859937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] MFA Rules not processed for user `c49d9711357248a787955e933f71451c`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:04.867670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:04.868293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:04.869007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:04.869295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:04.869572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] PATH_INFO: `/v3/users/46ea29383ff54400afc646a5a2d91f72` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:04.879779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ea29383ff54400afc646a5a2d91f72)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:04.881887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:05.018846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:05.023202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ea29383ff54400afc646a5a2d91f72'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:05.043202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ea29383ff54400afc646a5a2d91f72'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:05.053899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ea29383ff54400afc646a5a2d91f72'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:05.055085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ea29383ff54400afc646a5a2d91f72'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:05.067582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-623632b8-e20e-4059-92fb-c832d1b78399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ea29383ff54400afc646a5a2d91f72'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:05.102652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 865/1758] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:04 2022] DELETE /identity/v3/users/46ea29383ff54400afc646a5a2d91f72 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:05.109052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854c62-876f-4b24-8062-2e82706b76b0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.120588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854c62-876f-4b24-8062-2e82706b76b0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.121065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba854c62-876f-4b24-8062-2e82706b76b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.171880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 894/1759] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:05.184119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:05.186350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:05.192858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ba854c62-876f-4b24-8062-2e82706b76b0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:05.197506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ba854c62-876f-4b24-8062-2e82706b76b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:05.218958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:05.426011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a056a-9bbf-4873-9bab-0a8fcfb312d7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:05.433151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 866/1760] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:05.435197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.435601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.436112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.562731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:05.566287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:05.607655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:05.609967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.611539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.612386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.766357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 867/1761] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:24:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:05.768675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:05.810615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ffa4c-5d16-47d9-8035-9b21fb64fe50 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:05.824237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:05.824969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.825301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.825579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.826262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:05.826568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:05.828240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:05.833696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:05.835184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:05.858473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 895/1762] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:05.860738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 868/1763] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:05.869966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:05.897762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fd26-0e46-4483-951a-3b5185ec7365 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:05.905573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:05.912914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.913265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.913532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.914695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:05.916246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:05.983057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.003375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d4375-ad23-4cfa-aa3c-37c5b9d55501 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.007192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 896/1764] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:05 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:06.017309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.047257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:06.154366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.155106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.157363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.157673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.162685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:06.209264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:06.257250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307f763-95f1-49ce-ada8-d73d18d37098 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.287705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.288796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.289500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.307278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.313353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.326005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.326698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.329751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.370400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 869/1765] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:06.371377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.375753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:06.408494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 897/1766] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:06 2022] POST /identity/v3/users => generated 290 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:06.412514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.464213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b09ff-a287-4e4a-a953-b824e12565d5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.502005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.502649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.502940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.503216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.503877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.525102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.594899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 898/1767] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:06.600589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.670752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25298b4-03b4-4323-8cc9-3f61012caec9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.707523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.713119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.713434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.718096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.718865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.721915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.772951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 899/1768] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:06.781728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.816900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a05241-2279-48c1-a435-69e614b857bb service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.824922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.825908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.826343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.826767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.837181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c15a9-63c9-4294-8f7d-8de04d0e2b57 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:06.852686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:06.855279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:06.859225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:06.859715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] PATH_INFO: `/v3/projects/3b02d8d5869240d4b348b1e4afa67d21/users/20e9cc1abeba4f0ebe01f2e4f1f358d4/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:06.900717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b02d8d5869240d4b348b1e4afa67d21, user_id=20e9cc1abeba4f0ebe01f2e4f1f358d4, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.905182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.941220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 900/1769] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:06 2022] PUT /identity/v3/projects/3b02d8d5869240d4b348b1e4afa67d21/users/20e9cc1abeba4f0ebe01f2e4f1f358d4/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:06.941220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:06.941220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:06.958317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:06.964728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a96fc9-8bfd-4d3d-845b-83bb4100ebb7 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:06.982688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:06.998092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 870/1770] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:24:07.005465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:07.005918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:07.007417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:07.154830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] MFA Rules not processed for user `20e9cc1abeba4f0ebe01f2e4f1f358d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:07.159970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:07.262316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912260b-f1ca-4e69-bbd3-b4acd19f7652 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:07.303630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:07.309506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:07.312339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:07.312730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] PATH_INFO: `/v3/projects/56ed241deb04420893522c7213ba69e7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:07.326022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ed241deb04420893522c7213ba69e7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:07.343645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:07.443479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 871/1771] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:07.447983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:07.494517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deab1b-bbc8-4507-bb28-3e92628129ea None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:07.528064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:07.531531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:07.533296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:07.533692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:07.534348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:07.550691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:07.560819 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ed241deb04420893522c7213ba69e7', 'request_id': 'req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:07.586356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ed241deb04420893522c7213ba69e7', 'request_id': 'req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:07.605761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ed241deb04420893522c7213ba69e7', 'request_id': 'req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:07.642452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] The token cache is being invalidate because project 56ed241deb04420893522c7213ba69e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:07.643172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:07.647016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:07.652089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 901/1772] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:06 2022] DELETE /identity/v3/projects/56ed241deb04420893522c7213ba69e7 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:07.653923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:07.661547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:07.748508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 872/1773] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:07 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:07.752835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:07.765760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:07.826605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:08.023076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a7d8d-3c8d-4afa-9150-af9b32f64e87 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:08.024703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a789c2-20e9-4ac1-9b38-ffad6457f26e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:08.039369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:08.039660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:08.039867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:08.040118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] PATH_INFO: `/v3/projects/e5d1f458e6f64165b55590ab5041bbe8` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:08.042135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d1f458e6f64165b55590ab5041bbe8)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:08.042340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:08.043007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:08.043479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:08.044006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] PATH_INFO: `/v3/users/227fbd3c74ac471e890720d4df12a0c6` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:08.045951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227fbd3c74ac471e890720d4df12a0c6)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:08.046452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:08.048736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:08.190447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d1f458e6f64165b55590ab5041bbe8', 'request_id': 'req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.211256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d1f458e6f64165b55590ab5041bbe8', 'request_id': 'req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.224577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d1f458e6f64165b55590ab5041bbe8', 'request_id': 'req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.226882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227fbd3c74ac471e890720d4df12a0c6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.243776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227fbd3c74ac471e890720d4df12a0c6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.246544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:08.256096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] The token cache is being invalidate because project e5d1f458e6f64165b55590ab5041bbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:08.256671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.257920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.261958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 902/1774] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:07 2022] DELETE /identity/v3/projects/e5d1f458e6f64165b55590ab5041bbe8 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:08.265266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:08.271920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:08.297168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227fbd3c74ac471e890720d4df12a0c6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.304596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227fbd3c74ac471e890720d4df12a0c6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.305604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227fbd3c74ac471e890720d4df12a0c6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.342639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 873/1775] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:07 2022] DELETE /identity/v3/users/227fbd3c74ac471e890720d4df12a0c6 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:08.350668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:08.365976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:08.526966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54adac-21c0-40e4-9edf-1fbda2b2fd42 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:08.589374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343efa0-b615-490d-a78c-0548d9225e83 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:08.620718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:08.621424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:08.621707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:08.622007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] PATH_INFO: `/v3/users/9d5164361b93457ca787fc9ab1a4a5e3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:08.633860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5164361b93457ca787fc9ab1a4a5e3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:08.636514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:08.831453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:08.832196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:08.832575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:08.833000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:08.833824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:08.837801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:08.848223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:08.860695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5164361b93457ca787fc9ab1a4a5e3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.871919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 903/1776] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:08 2022] POST /identity/v3/users => generated 295 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:08.878557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:08.883234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:08.926671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502229-b7fe-44fb-b7d8-75f7ecf24cd9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:08.932758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5164361b93457ca787fc9ab1a4a5e3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.935949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:08.940591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:08.940591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:08.940591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:08.941435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:08.943484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:08.972789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5164361b93457ca787fc9ab1a4a5e3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.974823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5164361b93457ca787fc9ab1a4a5e3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.977773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5164361b93457ca787fc9ab1a4a5e3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:08.981027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 904/1777] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:08.984365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:08.990188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:09.025929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845792c-7e49-4a45-b21a-f907c0439757 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:09.033924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:09.035239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:09.037974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:09.038508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] PATH_INFO: `/v3/projects/17492bc3cfd54a1eb077368993cc56d9/users/7c4bda36d3cb4585a1c7ced0f2ab9879/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:09.047459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 874/1778] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:08 2022] DELETE /identity/v3/users/9d5164361b93457ca787fc9ab1a4a5e3 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:09.074831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17492bc3cfd54a1eb077368993cc56d9, user_id=7c4bda36d3cb4585a1c7ced0f2ab9879, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:09.079145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:09.114629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 905/1779] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:08 2022] PUT /identity/v3/projects/17492bc3cfd54a1eb077368993cc56d9/users/7c4bda36d3cb4585a1c7ced0f2ab9879/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:09.119675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:09.355024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fad5c7-63b4-440a-87d2-42b4c3d22414 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:09.388151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:09.590090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:09.593091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:09.594438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:09.596580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:09.599208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:09.601823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46431947-4322-4fc0-a10d-a3dbffe432e0 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:09.657831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:09.658831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 875/1780] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:09.710594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48532a43-937c-447e-af23-8dc39e25b8c2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:09.733821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:09.735020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:09.748433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:09.748760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] PATH_INFO: `/v3/projects/17492bc3cfd54a1eb077368993cc56d9/users/7c4bda36d3cb4585a1c7ced0f2ab9879/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:09.758032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17492bc3cfd54a1eb077368993cc56d9, user_id=7c4bda36d3cb4585a1c7ced0f2ab9879, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:09.775642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:09.835277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 906/1781] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:09 2022] PUT /identity/v3/projects/17492bc3cfd54a1eb077368993cc56d9/users/7c4bda36d3cb4585a1c7ced0f2ab9879/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:09.848906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369f88-cccc-4d49-b63d-28ae7ae63b53 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:09.849285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369f88-cccc-4d49-b63d-28ae7ae63b53 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:09.849623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57369f88-cccc-4d49-b63d-28ae7ae63b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:09.894450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-57369f88-cccc-4d49-b63d-28ae7ae63b53 None None] MFA Rules not processed for user `7c4bda36d3cb4585a1c7ced0f2ab9879`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:09.895941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-57369f88-cccc-4d49-b63d-28ae7ae63b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:10.103848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 876/1782] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:10.130792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:10.133466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:10.298888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d3e58-9704-4535-ae02-5a11b8cf3545 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:10.314988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:10.316295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:10.316795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:10.317322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:10.329558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:10.527300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:10.530686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:10.563194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 907/1783] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:11.651338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:11.652339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:11.652339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:11.697887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:11.704961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:12.022635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 877/1784] 10.222.0.71 () {58 vars in 1015 bytes} [Tue Aug 23 22:24:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:12.113368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:12.115752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:12.146059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f08846-7771-4eeb-91f4-b5b9ac1d1d20 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:12.172312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:12.173338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:12.173657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:12.174083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:12.226128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:12.235271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:12.285495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 908/1785] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:12.292639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:12.295010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:12.519332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:12.618884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32000b1-65d5-4b48-a158-e93932a27d80 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:12.627887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:12.628594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:12.629198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:12.629372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] PATH_INFO: `/v3/projects/6b8c2ffa40db49f4afdb114e15be4133` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:12.630638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8c2ffa40db49f4afdb114e15be4133)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:12.632955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:12.899442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8c2ffa40db49f4afdb114e15be4133', 'request_id': 'req-e0f00c20-88a0-4ef6-b449-19746e9971ec'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:12.926489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8c2ffa40db49f4afdb114e15be4133', 'request_id': 'req-e0f00c20-88a0-4ef6-b449-19746e9971ec'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:12.956021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8c2ffa40db49f4afdb114e15be4133', 'request_id': 'req-e0f00c20-88a0-4ef6-b449-19746e9971ec'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:12.998526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:13.017799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d5def-5fec-47ec-9d9f-b1635551d983 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:13.052318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] The token cache is being invalidate because project 6b8c2ffa40db49f4afdb114e15be4133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:13.056694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:13.060903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e0f00c20-88a0-4ef6-b449-19746e9971ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:13.086356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 878/1786] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:12 2022] DELETE /identity/v3/projects/6b8c2ffa40db49f4afdb114e15be4133 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:13.095116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a64d-a4a5-49e5-9104-f0183c1e86ed None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:13.098059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a64d-a4a5-49e5-9104-f0183c1e86ed None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:13.101317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9a64d-a4a5-49e5-9104-f0183c1e86ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:13.186608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:13.210618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f7f9a64d-a4a5-49e5-9104-f0183c1e86ed None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:13.221387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:13.222022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:13.222475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:13.222904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:13.230612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f7f9a64d-a4a5-49e5-9104-f0183c1e86ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:13.235636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:13.590421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 879/1787] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:13.593295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:13.593629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:13.594733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:13.614188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:13.623320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:13.669992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:13.688840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:13.704511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 909/1788] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:13.731030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 880/1789] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:13.739286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:13.775845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99374-5158-443f-bcce-8d9b1ba9bca7 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:13.785066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:13.786592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:13.787342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:13.788097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:13.789546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:13.790417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:13.794227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:13.827423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:13.841996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 910/1790] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:24:13.858809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672dfb7b-348d-4b20-ac3a-e2ddf04fbd6f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:13.890440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:13.891656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:13.894090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:13.894909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:13.897234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:13.901617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:13.962639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:13.989681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 881/1791] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:13 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:13.994188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c538b53-53b1-4a03-aa18-3679cdb62750 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:14.189566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:14.190658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:14.195390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:14.195880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:14.196692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:14.208995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:14.292933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:14.309851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 911/1792] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:13 2022] POST /identity/v3/users => generated 282 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:14.314604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f4d7c-bac4-43a7-aa88-e2dc5ccb51b7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:14.345620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:14.349954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:14.351596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:14.353419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:14.355099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:14.360599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:14.415477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:14.420464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 882/1793] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:24:14.439304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fa457-ac05-498a-86f2-229e3ba31e37 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:14.462644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:14.465684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:14.468650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:14.470872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:14.472014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:14.482562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2e49d-649e-46b6-acbc-f09abda98a49 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:14.563880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:14.565333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 912/1794] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:24:14.578827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fcca5-d28f-4816-bbac-95e84c1308c0 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:14.585472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:14.586571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:14.587072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:14.587571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] PATH_INFO: `/v3/projects/b4cb1d1ea41942e1a3bab9d6c79c7a66/users/d14c20a691354656878d76a8792899ff/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:14.631213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cb1d1ea41942e1a3bab9d6c79c7a66, user_id=d14c20a691354656878d76a8792899ff, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:14.647428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:14.702040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 883/1795] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:14 2022] PUT /identity/v3/projects/b4cb1d1ea41942e1a3bab9d6c79c7a66/users/d14c20a691354656878d76a8792899ff/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:14.715494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:14.716524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:14.718064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:14.917247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] MFA Rules not processed for user `d14c20a691354656878d76a8792899ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:14.922229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:15.130735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:15.211246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 913/1796] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:15.215974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:15.238354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:15.592044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba5485-52d5-4994-9d7e-66ba1764614b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:15.630950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:15.634970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:15.634970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:15.634970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:15.641086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:15.664366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:15.730701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:15.733327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:15.770884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c2033-90e1-48a3-97f7-5bf3683fca69 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:15.787333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:15.788527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:15.789425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:15.790208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] PATH_INFO: `/v3/projects/25d268849f2c49b984fb99a420a502f2` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:15.793618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d268849f2c49b984fb99a420a502f2)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:15.799072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:15.909755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 884/1797] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:15 2022] POST /identity/v3/projects => generated 365 bytes in 694 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:15.918631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:15.967705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d268849f2c49b984fb99a420a502f2', 'request_id': 'req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:15.985905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d268849f2c49b984fb99a420a502f2', 'request_id': 'req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:16.023554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d268849f2c49b984fb99a420a502f2', 'request_id': 'req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:16.145159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] The token cache is being invalidate because project 25d268849f2c49b984fb99a420a502f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:16.152291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:16.162472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-66a7a2b3-14d9-43fe-ab4a-d3e2d8dd646c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:16.166286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 914/1798] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:15 2022] DELETE /identity/v3/projects/25d268849f2c49b984fb99a420a502f2 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:16.181637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9eb93-1a5b-42ae-a87b-a47a9a7e5b81 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:16.182732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9eb93-1a5b-42ae-a87b-a47a9a7e5b81 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:16.185286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9eb93-1a5b-42ae-a87b-a47a9a7e5b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:16.337401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-82e9eb93-1a5b-42ae-a87b-a47a9a7e5b81 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:16.349271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-82e9eb93-1a5b-42ae-a87b-a47a9a7e5b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:16.504456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f004-5f8f-4cef-b787-73f67bb0139d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:16.799851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:16.802783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:16.806009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:16.814519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:16.819580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:16.844080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:16.907738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 915/1799] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 729 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:16.922246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:16.924177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:16.925241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.014561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 885/1800] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:15 2022] POST /identity/v3/users => generated 289 bytes in 1097 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:17.016717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.036417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:17.146083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:17.153428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8021-60cf-4634-8487-6509e00cef38 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.153708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:17.195420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.197643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.204349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 916/1801] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:17.206141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.212378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.219787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.221679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.239002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.242323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744db7f-e91f-4e4a-ab01-83af71f51087 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.253755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.255376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.256181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.256983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.258426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:17.259232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.263500 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.331559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 917/1802] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:24:17.338893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.339921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 886/1803] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:17.341411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.374835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f2b9-167d-49c7-8538-f07755155e88 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.384219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d3d6-a95c-4c5e-8827-ca9b8b888d1f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.395389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.396895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.397432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.397893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] PATH_INFO: `/v3/projects/78d867b4b852499284859e59f74a82f1/users/da74c81ea55341448d9ee514c37d9406/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.436243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.437386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.437952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.438514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.440379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.446758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.455253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d867b4b852499284859e59f74a82f1, user_id=da74c81ea55341448d9ee514c37d9406, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.463763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.478143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:17.505462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 887/1804] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:17 2022] PUT /identity/v3/projects/78d867b4b852499284859e59f74a82f1/users/da74c81ea55341448d9ee514c37d9406/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:17.506635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.628650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 918/1805] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:17 2022] POST /identity/v3/projects => generated 375 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:17.640749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:17.761723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:17.903765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec6db9-17aa-4a86-816b-f01a69166fee admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.928885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a8c1f-b5d6-4cb6-84fe-f27e26210a65 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:17.930320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.931436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.931873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.932208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.933398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.936619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.953240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:17.954069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:17.963061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:17.963772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:17.965410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:17.969442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:17.985918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 919/1806] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:17 2022] POST /identity/v3/users => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:17.993865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.015207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd67e74-84ae-49b0-bb33-0bd9683c0e12 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:18.033435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:18.037764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.038125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.038490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.039255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:18.042725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 888/1807] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:18.043252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:18.048490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.071400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e1f75-46f4-4066-b952-51179402a05e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:18.078601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 920/1808] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:18.084910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.087962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:18.089924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.092522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.093012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] PATH_INFO: `/v3/projects/78d867b4b852499284859e59f74a82f1/users/da74c81ea55341448d9ee514c37d9406/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.099245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d867b4b852499284859e59f74a82f1, user_id=da74c81ea55341448d9ee514c37d9406, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:18.109877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52c800-320d-4cdc-aefa-178e4476ae4a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:18.131584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55753e84-7757-46ae-bc4f-64fe72b3e086 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:18.155245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:18.157204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.157774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.158271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.166651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:18.170969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 889/1809] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:18 2022] PUT /identity/v3/projects/78d867b4b852499284859e59f74a82f1/users/da74c81ea55341448d9ee514c37d9406/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:18.174344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:18.192162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.192162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.192162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.258376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 921/1810] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:18.269518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.332925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c33cde-1338-475f-b0be-02b682e4c18a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:18.342170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] MFA Rules not processed for user `da74c81ea55341448d9ee514c37d9406`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:18.347040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:18.691207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 890/1811] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:18.709516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.710677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:18.713209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:18.713642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.714028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.714449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] PATH_INFO: `/v3/projects/bceb3b76637b48e799e1dbe31ee64385/users/7aa22d3a720247a0a2b0eb52505ff01d/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.756985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bceb3b76637b48e799e1dbe31ee64385, user_id=7aa22d3a720247a0a2b0eb52505ff01d, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:18.761730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e02c65-889d-4681-b529-f30638457bb0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:18.847312 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 922/1812] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:18 2022] PUT /identity/v3/projects/bceb3b76637b48e799e1dbe31ee64385/users/7aa22d3a720247a0a2b0eb52505ff01d/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:18.874788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.876043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.876665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.940878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44268726-783b-4756-a609-e04bcf15ec28 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:19.005769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:19.081175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] MFA Rules not processed for user `7aa22d3a720247a0a2b0eb52505ff01d`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:19.094708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:19.230196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:19.232088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:19.283344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:19.284105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:19.465201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 923/1813] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:19.466435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:19.494174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:19.626223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:19.629354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0f46d-bfa6-4966-aaba-39d06387ee4f service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:19.686427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 891/1814] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 982 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:19.688914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e7b1-5689-4154-bd1b-4edfe9ec983d None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:19.689370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e7b1-5689-4154-bd1b-4edfe9ec983d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:19.690026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e7b1-5689-4154-bd1b-4edfe9ec983d None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:19.691608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6212cb0-49e2-48a9-9015-bc8ce9989bbd None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:19.692650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 892/1815] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:24:19.724205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:19.733899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:19.734360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:19.734837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:19.741860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:19.760449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:19.766023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:19.766795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:19.767478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:19.850490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:19.854464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:19.936744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 924/1816] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:19 2022] POST /identity/v3/projects => generated 377 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:19.937842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:20.188073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 893/1817] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:24:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:20.189118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:20.223027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25241dc7-5af1-470c-826c-9db63018fa09 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:20.273461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ff53-a9f6-49b2-bad7-927dba0641c2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:20.300308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:20.301606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.302149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.302653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.303861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:20.311339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:20.366110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 925/1818] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:19 2022] POST /identity/v3/users => generated 295 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:20.368957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:20.374032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:20.434963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380632d-5891-49be-bd44-a48300345a9e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:20.446088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:20.447779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.448553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.449315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] PATH_INFO: `/v3/users/20e9cc1abeba4f0ebe01f2e4f1f358d4` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.454412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e9cc1abeba4f0ebe01f2e4f1f358d4)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:20.457458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:20.458513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:20.458877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.459373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.460400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.479983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:20.538586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:20.669468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:20.671377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:20.694908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 894/1819] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:20.706357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:20.746089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768c00-96be-4d8e-8dc4-2bb0010a6e6c service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:20.759419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e9cc1abeba4f0ebe01f2e4f1f358d4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:20.764663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e9cc1abeba4f0ebe01f2e4f1f358d4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:20.773350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:20.774109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.774413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.774671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.775353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:20.777228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a594c-6052-4eca-8d25-f1da2a51511d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:20.795518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e9cc1abeba4f0ebe01f2e4f1f358d4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:20.801456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e9cc1abeba4f0ebe01f2e4f1f358d4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:20.823764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a0592f3-4422-4099-a06f-8bc5e69028d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e9cc1abeba4f0ebe01f2e4f1f358d4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:20.832620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 895/1820] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:20.835819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.845647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.846600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.850528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 896/1821] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:24:20 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:24:20.852883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:20.863098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:20.873375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:20.911512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 926/1822] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:20 2022] DELETE /identity/v3/users/20e9cc1abeba4f0ebe01f2e4f1f358d4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:20.922136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fa4c-3270-44e2-ae04-0a7fa0711d3e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.922648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fa4c-3270-44e2-ae04-0a7fa0711d3e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.923141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574fa4c-3270-44e2-ae04-0a7fa0711d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.951266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c32a4-e675-44c3-a703-90058bea605b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:21.014378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b574fa4c-3270-44e2-ae04-0a7fa0711d3e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:21.016845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b574fa4c-3270-44e2-ae04-0a7fa0711d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:21.190804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:21.191961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.192517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.193014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] PATH_INFO: `/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41/users/29800fb3691a4e61a015a6861644bd39/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.255851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5d1e1d4af48c990fe457bbfbbcb41, user_id=29800fb3691a4e61a015a6861644bd39, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:21.260797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:21.275380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 927/1823] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:21.284529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.286341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.286904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.326871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 897/1824] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:20 2022] PUT /identity/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41/users/29800fb3691a4e61a015a6861644bd39/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:21.327793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:21.337152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:21.374752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:21.376938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:21.550468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25a95-623e-4ee1-8f10-405a84c4eb62 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:21.565746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:21.566435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.566710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.567006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.605199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 928/1825] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:21.606211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:21.709073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:21.776531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:21.780112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:21.846324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 898/1826] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:21.853840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8978a3d-53fa-4a84-b3b5-3f1b69ef08be None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:21.865446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:21.866929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.867632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.868323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.869970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:21.874639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae5b0-2c9d-49fc-8204-1ce2ffecffa3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:21.905517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:21.915592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 929/1827] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:21.936374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56182cc-ed35-478b-89ab-fa0cc86a5c4c service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:21.964835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:21.967132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.969225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.970006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] PATH_INFO: `/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41/users/29800fb3691a4e61a015a6861644bd39/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.976425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb5d1e1d4af48c990fe457bbfbbcb41, user_id=29800fb3691a4e61a015a6861644bd39, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:21.985167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:22.039903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 899/1828] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:21 2022] PUT /identity/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41/users/29800fb3691a4e61a015a6861644bd39/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:22.056864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:22.057482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:22.058074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:22.192370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] MFA Rules not processed for user `29800fb3691a4e61a015a6861644bd39`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:22.194851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:22.248644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:22.499242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 930/1829] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:22.750349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:22.753591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:23.018215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde913c-9536-4c02-9039-d0c36438b482 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:23.036795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:23.038072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:23.038556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:23.039023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:23.042622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:23.139578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:23.148767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:23.318269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:23.318269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:23.338724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 900/1830] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:23.489034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:23.491996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:23.673631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3d45-1be6-4040-a3d2-c58eac608330 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:23.709503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:23.710611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:23.711096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:23.711579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:23.727131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:23.811737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:23.821598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:23.961538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 931/1831] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 824 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:24.099219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1f157-6211-4ce7-8cd0-da94c2ec081f service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:24.124731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:24.126471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:24.128701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:24.129380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:24.241575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:24.248675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:24.351500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 901/1832] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:25.988623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:25.991416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:26.270649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd6f5e-838e-4daf-9724-3873fc475b10 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:26.287529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:26.291658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:26.293375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:26.295212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] PATH_INFO: `/v3/projects/3b02d8d5869240d4b348b1e4afa67d21` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:26.301887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b02d8d5869240d4b348b1e4afa67d21)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:26.308428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:26.432872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:26.444642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b02d8d5869240d4b348b1e4afa67d21', 'request_id': 'req-0065eb7f-bff5-43b3-8ae0-90d5bf249011'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.459641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b02d8d5869240d4b348b1e4afa67d21', 'request_id': 'req-0065eb7f-bff5-43b3-8ae0-90d5bf249011'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.473801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b02d8d5869240d4b348b1e4afa67d21', 'request_id': 'req-0065eb7f-bff5-43b3-8ae0-90d5bf249011'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.500287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] The token cache is being invalidate because project 3b02d8d5869240d4b348b1e4afa67d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:26.500608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.501413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.505159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 932/1833] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:25 2022] DELETE /identity/v3/projects/3b02d8d5869240d4b348b1e4afa67d21 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:26.508248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:26.517787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:26.530396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44014f70-a78d-4d93-9b21-cc90f30700c8 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:26.741043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:26.742738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:26.743492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:26.743958 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] PATH_INFO: `/v3/users/7c4bda36d3cb4585a1c7ced0f2ab9879` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:26.746534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4bda36d3cb4585a1c7ced0f2ab9879)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:26.752296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:26.945506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4bda36d3cb4585a1c7ced0f2ab9879'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:26.991030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4bda36d3cb4585a1c7ced0f2ab9879'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:27.001771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4bda36d3cb4585a1c7ced0f2ab9879'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:27.002726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4bda36d3cb4585a1c7ced0f2ab9879'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:27.003399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4bda36d3cb4585a1c7ced0f2ab9879'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:27.032849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 902/1834] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:26 2022] DELETE /identity/v3/users/7c4bda36d3cb4585a1c7ced0f2ab9879 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:27.313086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:27.315561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:27.485715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065eb7f-bff5-43b3-8ae0-90d5bf249011 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:27.607768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:27.609157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:27.609391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:27.609981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:27.613844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:27.801626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:27.802631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb4156-1162-44b7-bb26-ae7a0e08e53c service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:27.822552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 933/1835] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:28.316350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:28.319708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:28.484941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6153a-4371-4aa4-8a5b-b6607591d205 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:28.491333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:28.491873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:28.492126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:28.492377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] PATH_INFO: `/v3/projects/17492bc3cfd54a1eb077368993cc56d9` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:28.493823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17492bc3cfd54a1eb077368993cc56d9)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:28.495974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:28.559167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:28.618647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17492bc3cfd54a1eb077368993cc56d9', 'request_id': 'req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:28.634811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17492bc3cfd54a1eb077368993cc56d9', 'request_id': 'req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:28.648945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17492bc3cfd54a1eb077368993cc56d9', 'request_id': 'req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:28.678543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] The token cache is being invalidate because project 17492bc3cfd54a1eb077368993cc56d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:28.679524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:28.680267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d2801bd3-81d9-46aa-936c-ce5a1fdd0a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:28.682584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 903/1836] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:28 2022] DELETE /identity/v3/projects/17492bc3cfd54a1eb077368993cc56d9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:28.689439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:28.690191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:28.690481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:28.723451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:28.726432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:28.795978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:28.872617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 934/1837] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:28.882659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:28.883162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:28.883752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:28.920261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:28.922512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:28.938916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 904/1838] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:28.944993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:28.964196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c3853-9204-412d-b96d-f4afde053d0a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:28.973579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:28.974611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:28.975105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:28.975592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:28.976921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:28.977485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:28.981916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.009389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 935/1839] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:29.017047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.035599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65a8a6-bd00-49d7-a915-fa3ac17117ef None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.044654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.046658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.047313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.047674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.049052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.052988 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.103349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 905/1840] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:29 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:29.107016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.128358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10085e-4e41-49fa-8e5c-06e320afe4a0 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.261479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.262254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.262589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.262922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.263734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.267358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.298970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 936/1841] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:29 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:29.305763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.328219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99f678-fb8d-4f97-9e49-2d92fb7997fc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.351061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.354142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.354583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.355286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.360058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.365078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.393432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 906/1842] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:29.400353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.414497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529274-fcb0-4ed8-ae49-89df1afbf99f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.426034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.426685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.427142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.427142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.428302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.429984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fad21-7e0e-4290-a382-51ec0044ca23 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.444974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 937/1843] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:29.452568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.474986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9322fb7-d0ff-46a2-a2d6-db6f6d600d96 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.494478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.494478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.496026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.496389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] PATH_INFO: `/v3/projects/583415517c47418f978349ada93ab3b9/users/b225eca557b84fcb9b6fd3507acb7922/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.520611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=583415517c47418f978349ada93ab3b9, user_id=b225eca557b84fcb9b6fd3507acb7922, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.523920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.541653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 907/1844] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:29 2022] PUT /identity/v3/projects/583415517c47418f978349ada93ab3b9/users/b225eca557b84fcb9b6fd3507acb7922/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:29.562855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.563342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.563800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.610995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] MFA Rules not processed for user `b225eca557b84fcb9b6fd3507acb7922`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:29.613036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:29.724287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 938/1845] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:29.730342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.841697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3766d-8690-402d-9983-0d164e6cbb1a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:29.859213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:29.859978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:29.863716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:29.864256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:29.865247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:29.867328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:29.909069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 908/1846] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:29 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:29.914054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:29.942725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff273f9f-8ab4-49f4-b405-b5c254131f8f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.019855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:30.070309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.071031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.071310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.071609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.072539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.075263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:30.100322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 939/1847] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:29 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:30.104462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:30.116584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f500c2e-5c7e-443f-8c5b-63f9668e0b5f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.124060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.125211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.125599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.125982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.126847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.129672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:30.149734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 909/1848] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:30.151898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:30.166220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617aa2-268e-4db4-bb0b-1424a99a9875 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.172277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.173182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.173711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.173942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] PATH_INFO: `/v3/projects/e3e4108994394bc982747c6e23bd1e6b/users/1c0c8546073045a589ba51b922908154/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.196220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e4108994394bc982747c6e23bd1e6b, user_id=1c0c8546073045a589ba51b922908154, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.199564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:30.219662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 940/1849] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:30 2022] PUT /identity/v3/projects/e3e4108994394bc982747c6e23bd1e6b/users/1c0c8546073045a589ba51b922908154/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:30.223544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:30.253460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7914-78b3-4aab-8648-e62eaf37b313 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.323522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:30.390840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.391739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.391915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.392351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.393378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.396443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387426-f71a-424c-9274-7aa937eaf6a5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:30.424613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 910/1850] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:30.429009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:30.461151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17afdc-daa1-4e85-ac61-56aa3abcf949 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.478308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.482386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.482879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.486086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] PATH_INFO: `/v3/projects/e3e4108994394bc982747c6e23bd1e6b/users/1c0c8546073045a589ba51b922908154/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.500149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e4108994394bc982747c6e23bd1e6b, user_id=1c0c8546073045a589ba51b922908154, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.534838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:30.589091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 941/1851] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:30 2022] PUT /identity/v3/projects/e3e4108994394bc982747c6e23bd1e6b/users/1c0c8546073045a589ba51b922908154/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:30.648694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.649351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.649785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.696045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] MFA Rules not processed for user `1c0c8546073045a589ba51b922908154`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:30.697754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:30.837865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 911/1852] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:30 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:30.847627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:30.850638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:30.963699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d054-3222-44ee-a6d4-7ce3b1908704 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:30.970506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:30.971520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:30.971974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:30.972315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:30.985395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:30.988996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:31.002032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 942/1853] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:31.576277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.602443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c71c2d-1bbc-4c3d-b425-550b9abc5dad None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:31.619360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0c8546073045a589ba51b922908154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3e4108994394bc982747c6e23bd1e6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:31.620459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:31.621212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:31.622339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:31.624592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:31.625441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:31.628481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:31.657047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 912/1854] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:31.661542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.672406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230fb6-9173-4645-a6a9-7cad745cc815 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:31.678837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0c8546073045a589ba51b922908154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3e4108994394bc982747c6e23bd1e6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:31.679421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:31.679709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:31.680217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:31.681102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:31.683231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:31.718768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 943/1855] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:31 2022] POST /identity/v3/projects => generated 355 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:31.724120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.744570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6966d-4394-40dd-b038-5bd9846a15ce tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:31.854956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0c8546073045a589ba51b922908154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3e4108994394bc982747c6e23bd1e6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:31.855726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:31.856856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:31.857237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:31.858196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:31.858519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:31.860403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:31.876700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 913/1856] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:24:31.922295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.926153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:31.955609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.975861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0bbb-519b-4d42-9b89-3f2049d15b9c tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:31.985505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c0c8546073045a589ba51b922908154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3e4108994394bc982747c6e23bd1e6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:31.987750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:31.988341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:31.989592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] PATH_INFO: `/v3/projects/56ac865afc4b480d8315be885ff32a0a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:31.991305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56ac865afc4b480d8315be885ff32a0a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:31.993691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:32.045691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:32.085582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ac865afc4b480d8315be885ff32a0a', 'request_id': 'req-38c1df80-946d-4c9c-a1e2-bd9a8f966395'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.096419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ac865afc4b480d8315be885ff32a0a', 'request_id': 'req-38c1df80-946d-4c9c-a1e2-bd9a8f966395'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.105324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ac865afc4b480d8315be885ff32a0a', 'request_id': 'req-38c1df80-946d-4c9c-a1e2-bd9a8f966395'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.128998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] The token cache is being invalidate because project 56ac865afc4b480d8315be885ff32a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:32.129396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.130447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.133995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 914/1857] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:31 2022] DELETE /identity/v3/projects/56ac865afc4b480d8315be885ff32a0a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:32.143596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716560-ef77-4863-8296-a71ed4c88b67 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:32.152410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:32.242051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:32.244447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:32.280587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:32.281600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:32.281955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:32.282344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] PATH_INFO: `/v3/users/03b5bf15e03d47bb888e4c1bee8ee6a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:32.285142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b5bf15e03d47bb888e4c1bee8ee6a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:32.288458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:32.388094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b5bf15e03d47bb888e4c1bee8ee6a0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.388789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b5bf15e03d47bb888e4c1bee8ee6a0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.400185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1df80-946d-4c9c-a1e2-bd9a8f966395 tempest-VolumeQuotaClassesTest-639514321 tempest-VolumeQuotaClassesTest-639514321-project-admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:32.428900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b5bf15e03d47bb888e4c1bee8ee6a0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.428900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b5bf15e03d47bb888e4c1bee8ee6a0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.430810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:32.430810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:32.430810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:32.430810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] PATH_INFO: `/v3/users/d14c20a691354656878d76a8792899ff` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:32.436080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14c20a691354656878d76a8792899ff)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:32.438366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:32.446804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fd95419-962e-4cd7-a41c-5e7bee61a6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b5bf15e03d47bb888e4c1bee8ee6a0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.510877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 944/1858] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:31 2022] DELETE /identity/v3/users/03b5bf15e03d47bb888e4c1bee8ee6a0 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:32.517061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:32.517716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:32.518186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:32.554245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:32.556268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:32.586245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14c20a691354656878d76a8792899ff'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.640258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14c20a691354656878d76a8792899ff'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.669883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14c20a691354656878d76a8792899ff'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.672127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14c20a691354656878d76a8792899ff'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.673494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d7147940-2308-4461-b038-fdf25204bc19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14c20a691354656878d76a8792899ff'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:32.691684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 945/1859] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:32.700779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:32.703478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:32.713627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 915/1860] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:32 2022] DELETE /identity/v3/users/d14c20a691354656878d76a8792899ff => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:32.719688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:32.719987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:32.720284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:32.754243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:32.756180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:32.819903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:32.825611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:32.889886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ab865-0198-4278-adcc-0e9ced41e99a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:32.915072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 916/1861] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:32.932917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:33.019319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60b629-4366-427a-bd06-1aad0f7fd1c5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:33.032027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:33.032787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:33.033242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:33.033525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:33.063266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:33.065387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:33.095844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 917/1862] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:33.104357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:33.107893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:33.118751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:33.119660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:33.119773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:33.120037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:33.147656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc54dba-c041-4534-9b75-a0373a19864d service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:33.164479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:33.168142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95523703-29eb-4dee-8ad9-649c1e675f56 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:33.186763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:33.188062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:33.188532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:33.189025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] PATH_INFO: `/v3/users/b225eca557b84fcb9b6fd3507acb7922` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:33.191908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 946/1863] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:33.194268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b225eca557b84fcb9b6fd3507acb7922)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:33.199342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:33.288989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b225eca557b84fcb9b6fd3507acb7922'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:33.311402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b225eca557b84fcb9b6fd3507acb7922'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:33.324188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b225eca557b84fcb9b6fd3507acb7922'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:33.325092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b225eca557b84fcb9b6fd3507acb7922'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:33.325957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b225eca557b84fcb9b6fd3507acb7922'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:33.366963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 918/1864] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:33 2022] DELETE /identity/v3/users/b225eca557b84fcb9b6fd3507acb7922 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:33.373522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:33.374174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:33.374840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:33.405875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:33.407539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:33.542750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 947/1865] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:33.598437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:33.603020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:33.683130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:33.703191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e8831-563d-42df-8136-f071081c2880 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:33.719188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:33.719748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:33.720346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:33.720346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:33.734767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:33.736297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:33.751020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 919/1866] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:34.894714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:34.897651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:34.926068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0d5bf-5151-4525-b22a-2f6fa4253d3a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:34.939601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:34.941004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:34.941612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:34.942856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] PATH_INFO: `/v3/projects/b4cb1d1ea41942e1a3bab9d6c79c7a66` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:34.946015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cb1d1ea41942e1a3bab9d6c79c7a66)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:34.954327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:34.956238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:34.958352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:34.992573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7da85f-38ad-4319-82df-78bd73230334 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:35.010077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:35.011350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:35.013073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:35.013073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] PATH_INFO: `/v3/projects/3930a77e8a704b0e8bb2287d20415fdf` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:35.026129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3930a77e8a704b0e8bb2287d20415fdf)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:35.034627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:35.088460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cb1d1ea41942e1a3bab9d6c79c7a66', 'request_id': 'req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.107397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cb1d1ea41942e1a3bab9d6c79c7a66', 'request_id': 'req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.120292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cb1d1ea41942e1a3bab9d6c79c7a66', 'request_id': 'req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.143796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3930a77e8a704b0e8bb2287d20415fdf', 'request_id': 'req-bc88554f-2ea8-4466-94b8-5cb57c924096'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.156011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] The token cache is being invalidate because project b4cb1d1ea41942e1a3bab9d6c79c7a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:35.156377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.157442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.160972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 948/1867] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:34 2022] DELETE /identity/v3/projects/b4cb1d1ea41942e1a3bab9d6c79c7a66 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:35.165328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3930a77e8a704b0e8bb2287d20415fdf', 'request_id': 'req-bc88554f-2ea8-4466-94b8-5cb57c924096'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.171628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:35.174917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3930a77e8a704b0e8bb2287d20415fdf', 'request_id': 'req-bc88554f-2ea8-4466-94b8-5cb57c924096'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.177140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:35.198562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] The token cache is being invalidate because project 3930a77e8a704b0e8bb2287d20415fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:35.198910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.200358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.202610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 920/1868] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:34 2022] DELETE /identity/v3/projects/3930a77e8a704b0e8bb2287d20415fdf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:35.203046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:35.203525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:35.205017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:35.292792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21e2b4-8268-46fd-ae6d-72fbca93bf78 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:35.355440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88554f-2ea8-4466-94b8-5cb57c924096 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:35.373488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:35.374955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:35.379342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:35.381090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] PATH_INFO: `/v3/projects/583415517c47418f978349ada93ab3b9` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:35.384688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583415517c47418f978349ada93ab3b9)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:35.391776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:35.444644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:35.445482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:35.445827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:35.446173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] PATH_INFO: `/v3/users/da74c81ea55341448d9ee514c37d9406` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:35.447926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da74c81ea55341448d9ee514c37d9406)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:35.450794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:35.512088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583415517c47418f978349ada93ab3b9', 'request_id': 'req-2a66c281-abcf-4601-9e58-c3b36d0feca2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.521601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583415517c47418f978349ada93ab3b9', 'request_id': 'req-2a66c281-abcf-4601-9e58-c3b36d0feca2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.530900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583415517c47418f978349ada93ab3b9', 'request_id': 'req-2a66c281-abcf-4601-9e58-c3b36d0feca2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.552499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da74c81ea55341448d9ee514c37d9406'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.553980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da74c81ea55341448d9ee514c37d9406'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.554947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:35.572992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] The token cache is being invalidate because project 583415517c47418f978349ada93ab3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:35.573531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.575330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da74c81ea55341448d9ee514c37d9406'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.576536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da74c81ea55341448d9ee514c37d9406'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.578324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.589918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da74c81ea55341448d9ee514c37d9406'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.594532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 921/1869] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:35 2022] DELETE /identity/v3/projects/583415517c47418f978349ada93ab3b9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:35.596526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:35.601470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:35.620462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 949/1870] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:35 2022] DELETE /identity/v3/users/da74c81ea55341448d9ee514c37d9406 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:35.623274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:35.625621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:35.710225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:35.787885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06009acc-1534-42b2-a1ec-3a0ba5d76699 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:35.797668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:35.798347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:35.798996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:35.799356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] PATH_INFO: `/v3/users/1c0c8546073045a589ba51b922908154` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:35.801373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0c8546073045a589ba51b922908154)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:35.812279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:35.868030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66c281-abcf-4601-9e58-c3b36d0feca2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:35.884125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:35.885729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:35.886341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:35.886951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] PATH_INFO: `/v3/users/c49d9711357248a787955e933f71451c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:35.890519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49d9711357248a787955e933f71451c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:35.897827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:35.910499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0c8546073045a589ba51b922908154'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.912139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0c8546073045a589ba51b922908154'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.927160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0c8546073045a589ba51b922908154'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.928146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0c8546073045a589ba51b922908154'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:35.944419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-48fcdec9-7ad6-47cb-afac-f9cd7f31bd78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0c8546073045a589ba51b922908154'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.037110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 950/1871] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:35 2022] DELETE /identity/v3/users/1c0c8546073045a589ba51b922908154 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:36.058874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49d9711357248a787955e933f71451c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.093490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49d9711357248a787955e933f71451c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.113620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49d9711357248a787955e933f71451c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.115032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49d9711357248a787955e933f71451c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.116554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ce4b54f1-a891-437a-a097-50f60511facd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49d9711357248a787955e933f71451c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:36.158307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 922/1872] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:35 2022] DELETE /identity/v3/users/c49d9711357248a787955e933f71451c => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:36.231902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:36.232654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:36.233177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:36.235767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 951/1873] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:24:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:24:36.255070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:36.255778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:36.256130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:36.289204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:36.291042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:36.482318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 923/1874] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:24:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:36.732674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:36.737928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:36.741866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:36.744401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:36.797335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7113448-ac12-4da7-9f75-3883a6643c63 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:36.810973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:36.823176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:36.825680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:36.826250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:36.826737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:36.878426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:36.883854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:36.915667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 952/1875] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:36.917571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:36.920787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:36.991819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6defd1-6a34-4136-9519-306ce95c9c62 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.021727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.022412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.022718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.022993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] PATH_INFO: `/v3/projects/5d8ba88b4e044f049df758ff18e24b20` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.025523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8ba88b4e044f049df758ff18e24b20)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.030971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.066670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791e83a-bffa-4210-b498-77642cb1da1b service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.073700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.075638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.076754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.077860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] PATH_INFO: `/v3/projects/78d867b4b852499284859e59f74a82f1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.080784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d867b4b852499284859e59f74a82f1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.083303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.138511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8ba88b4e044f049df758ff18e24b20', 'request_id': 'req-21b346dc-5822-4636-aac3-beea66342595'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.165989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8ba88b4e044f049df758ff18e24b20', 'request_id': 'req-21b346dc-5822-4636-aac3-beea66342595'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.188874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:37.189961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8ba88b4e044f049df758ff18e24b20', 'request_id': 'req-21b346dc-5822-4636-aac3-beea66342595'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.201883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d867b4b852499284859e59f74a82f1', 'request_id': 'req-25a4fcd7-04e7-4f92-903a-38b65c444ec8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.225795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d867b4b852499284859e59f74a82f1', 'request_id': 'req-25a4fcd7-04e7-4f92-903a-38b65c444ec8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.230793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] The token cache is being invalidate because project 5d8ba88b4e044f049df758ff18e24b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:37.231817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.233375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-21b346dc-5822-4636-aac3-beea66342595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.235872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 924/1876] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:36 2022] DELETE /identity/v3/projects/5d8ba88b4e044f049df758ff18e24b20 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:37.246033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c0cd-60a2-4bd2-a8c4-cbf76b1713f2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.247127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c0cd-60a2-4bd2-a8c4-cbf76b1713f2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.247452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6c0cd-60a2-4bd2-a8c4-cbf76b1713f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.253865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d867b4b852499284859e59f74a82f1', 'request_id': 'req-25a4fcd7-04e7-4f92-903a-38b65c444ec8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.279024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a9e6c0cd-60a2-4bd2-a8c4-cbf76b1713f2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:37.280552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a9e6c0cd-60a2-4bd2-a8c4-cbf76b1713f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.305976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] The token cache is being invalidate because project 78d867b4b852499284859e59f74a82f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:37.306496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.307907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-25a4fcd7-04e7-4f92-903a-38b65c444ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.326825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 953/1877] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:36 2022] DELETE /identity/v3/projects/78d867b4b852499284859e59f74a82f1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:37.334103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd1897-60f1-419a-a00a-f3ea66460563 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.334496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd1897-60f1-419a-a00a-f3ea66460563 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.334919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd1897-60f1-419a-a00a-f3ea66460563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.377045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-62fd1897-60f1-419a-a00a-f3ea66460563 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:37.378640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-62fd1897-60f1-419a-a00a-f3ea66460563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.526594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 925/1878] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:37.539088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.539668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.539916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.568933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 954/1879] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:37.574118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.576159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.576159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.587407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:37.589808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.607326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:37.609044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.610722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 926/1880] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:37.612607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.619693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.642742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 955/1881] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:37.645078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.657060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e1d3-c9c9-4168-a725-ea4883f35544 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.665046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522bf4e-4dfb-45a9-9e2c-c205618c3320 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.672723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.673305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.673714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.674250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.674835 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.675229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:37.675589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.676022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.676609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.677928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] PATH_INFO: `/v3/projects/e3e4108994394bc982747c6e23bd1e6b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.678113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.693965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e4108994394bc982747c6e23bd1e6b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.706079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.709130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 956/1882] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:37.710134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.734865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ebd-b93f-4d61-bd7a-163ea79dcc02 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.743007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.743792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.744073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.744356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.745754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:37.745754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.748843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.780117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 957/1883] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:37.780117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.798720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39510646-3b0d-4aa7-828f-4644c36dece8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.805426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:37.806139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.806916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.807233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.807514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.808261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.811383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:37.843980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e4108994394bc982747c6e23bd1e6b', 'request_id': 'req-5b84dcef-421c-41d1-b6c3-a37da0a24562'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.858384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 958/1884] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:37.858736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e4108994394bc982747c6e23bd1e6b', 'request_id': 'req-5b84dcef-421c-41d1-b6c3-a37da0a24562'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.862834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.882737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e4108994394bc982747c6e23bd1e6b', 'request_id': 'req-5b84dcef-421c-41d1-b6c3-a37da0a24562'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.905374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] The token cache is being invalidate because project e3e4108994394bc982747c6e23bd1e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:37.905692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.906445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:37.908917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 927/1885] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:37 2022] DELETE /identity/v3/projects/e3e4108994394bc982747c6e23bd1e6b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:37.910813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:37.913911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:37.980169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c7d9e-4274-4a8d-ae17-9f65f35d6133 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:37.989531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:37.990586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:37.991087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:37.991581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:37.992897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:37.997878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b04a55-084d-42cb-8cf4-28fe9512e002 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.041234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84dcef-421c-41d1-b6c3-a37da0a24562 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.049579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.050648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.051130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.051749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.052634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.056134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.066672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 959/1886] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:38.069430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.069918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.070834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.089958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:38.096838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 928/1887] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:37 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:38.099083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.102304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:38.122559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:38.125586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:38.128205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785e98f-28ce-45f9-a10a-12cc95826852 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.251152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.252171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.252520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.252755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.254788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.256064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf2cb-d83b-4d89-9809-3dcaf01e9986 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.285668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 960/1888] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:38.285668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.296017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e60f-8c4e-4f87-b70b-f888edf69497 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.302798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.303540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.303893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.304322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.305208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.307481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.307871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 929/1889] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:38.311556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.312037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.313390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.329833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 961/1890] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:38.329833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.348279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08877c-c194-44da-afdf-91c1a162b8bb admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.352458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:38.354891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:38.356352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.357310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.357705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.358664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.359643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.362593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.370146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 930/1891] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:38.371384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.385548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 962/1892] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:38.388787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.399578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048f50a-53a3-4da5-a3d3-b4f298a0dc16 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.408969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c680-b22c-4af7-af2a-4ff733c5b63d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.414387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.414891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.415465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.420943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.420943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.421466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.426250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.427662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.431864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.431864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.434726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:38.435389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.438739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.444312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 931/1893] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:38.445963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.470424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb798f8-4a90-4620-9892-d06f05d29e9a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.479984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 963/1894] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:38.480247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.481581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.482058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.482535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.483784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.484059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.487668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.504221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fa45a-c973-43ae-84b9-e6b5f6910a42 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.517215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 932/1895] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:38.517215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.520330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.521445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.521905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.522373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] PATH_INFO: `/v3/projects/22bfd0abdf6a4df6b8ac40832bb73756/users/854731041b3745379330b135524c3fde/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.545909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89010-1618-4d30-acf4-c62d0f389efc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.556074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.557246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.557731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bfd0abdf6a4df6b8ac40832bb73756, user_id=854731041b3745379330b135524c3fde, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.557932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.558237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.560554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.564365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c8421-dbb1-471d-b3da-4bf842f7cf9f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.564629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:38.576379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=5,keystone:INSERT=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:38.592909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 964/1896] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:38 2022] PUT /identity/v3/projects/22bfd0abdf6a4df6b8ac40832bb73756/users/854731041b3745379330b135524c3fde/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:38.594130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.637614 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 933/1897] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:38.641120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.641662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.642557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.710096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] MFA Rules not processed for user `854731041b3745379330b135524c3fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:38.712990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:38.778356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630336ee-419e-4310-bb6e-1a354bfe86a9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:38.878657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 934/1898] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:38.881005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:38.904971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:38.939936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:38.941459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:38.942346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:38.943062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] PATH_INFO: `/v3/projects/ef7cccc2e2524db8b51ed4d7c8b1fe1c/users/848bed45f5ee49e6aadb8e3f84146410/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:38.983649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7cccc2e2524db8b51ed4d7c8b1fe1c, user_id=848bed45f5ee49e6aadb8e3f84146410, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:38.986579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.020266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 965/1899] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:38 2022] PUT /identity/v3/projects/ef7cccc2e2524db8b51ed4d7c8b1fe1c/users/848bed45f5ee49e6aadb8e3f84146410/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:39.021844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.067567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63df39-caa3-46f9-8d51-618ecf50d850 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.174787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.175525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.176032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.176585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.177422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.179524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bab2e-36aa-4e4a-92b8-1ed17dd5fa26 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.184063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699588-9509-458e-9839-1a0d810ff94a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.194637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.195616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.196680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.196680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.198201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.202246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.226348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 935/1900] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:38 2022] POST /identity/v3/users => generated 290 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:39.228416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.228905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.229360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.284589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:39.287787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 966/1901] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:39 2022] POST /identity/v3/projects => generated 377 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:39.290514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.293089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] MFA Rules not processed for user `848bed45f5ee49e6aadb8e3f84146410`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:39.297056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:39.430586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 936/1902] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:39.435937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.440559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92a2c5-4544-4bde-a50e-5b97f2fa66f1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.449100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.450184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.450652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.451169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.452356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.455658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.459858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911421d5-650b-4a4d-970f-819fa1c2ca8a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.469459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.470760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.471365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.471932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.473180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.479165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 967/1903] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:39.479373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.479492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.501764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53e8a3-7162-403d-acc0-366f7463d476 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.520569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.520569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.521069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.521266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.521885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.525013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.532779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 937/1904] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:39 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:39.534574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.554733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5206c00-3f00-43d4-972e-cc6445f693a0 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.567332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.568256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.568917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.569360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.570232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.572324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.584542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 968/1905] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:39 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:39.586950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.610921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 938/1906] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:39.612894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.635864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a3ae-f6f1-40ae-98a8-8429d0c03f62 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.737606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:39.798486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.799867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.800531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.801070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.803129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.808178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.814655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae024-235e-4218-8757-8d67a99f0010 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.827153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.828493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.829115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.829668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.831219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.834912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.894877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 969/1907] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:39.896425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.916845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce853-bbc6-4b3a-9b7f-b3cbeda27c54 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.923663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 939/1908] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:39 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:39.924329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.925210 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.925739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:39.926156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] PATH_INFO: `/v3/projects/3987d93e16c24deabce4b7adccff4655/users/da9dba38970a4d2c8edb966bbd6e8452/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:39.932684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:39.968883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eb400-eb71-4345-b05c-1240eba89253 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:39.977551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3987d93e16c24deabce4b7adccff4655, user_id=da9dba38970a4d2c8edb966bbd6e8452, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:39.984336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:39.997468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:39.998904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:39.999461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.000000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] PATH_INFO: `/v3/projects/04c27d6b311d4be583c6ab9d464340a2/users/922580e020f14a2a9c82027d21ca0e34/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.016060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 970/1909] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:39 2022] PUT /identity/v3/projects/3987d93e16c24deabce4b7adccff4655/users/da9dba38970a4d2c8edb966bbd6e8452/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:40.026489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.084293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c27d6b311d4be583c6ab9d464340a2, user_id=922580e020f14a2a9c82027d21ca0e34, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.097201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.126446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ab51e-53e4-46fe-bde2-1ca2a4c8492a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.139648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.140704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.141198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.141581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.142553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.144493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c20fc-d678-4bf4-b463-23b9c8d4105e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.169948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 971/1911] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:40.169948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.169948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.169948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.171448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 940/1911] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:39 2022] PUT /identity/v3/projects/04c27d6b311d4be583c6ab9d464340a2/users/922580e020f14a2a9c82027d21ca0e34/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:40.173314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.213816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] MFA Rules not processed for user `da9dba38970a4d2c8edb966bbd6e8452`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:40.216092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:40.303050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:40.359684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 972/1912] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:40.360350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18910c22-d845-4479-b8dd-211082743b91 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.360683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.374059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb900d-d42f-4971-a1b6-c303ccbbe844 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.376080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.379006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.380179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.380467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.380747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.380980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.381503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.381751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.382391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] PATH_INFO: `/v3/projects/ecb736fffa2442ba997dd1c7aa36c730/users/740ab2f6de784772a1e5926a52fa642d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.383302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.409759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 973/1913] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:40.411046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.430375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424672b0-2563-4335-9aed-350f7ecc2cca admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.441857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb736fffa2442ba997dd1c7aa36c730, user_id=740ab2f6de784772a1e5926a52fa642d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.447501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.450370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.451727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.452090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.452363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.453074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.455172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.482892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 941/1914] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:40 2022] PUT /identity/v3/projects/ecb736fffa2442ba997dd1c7aa36c730/users/740ab2f6de784772a1e5926a52fa642d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:40.484908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.521785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:40.541548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 974/1915] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:40 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:40.541548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.703656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a771f-3bda-401e-8ca8-88e710f347f5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.710168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.710546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.710820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.711089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.711764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.713464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.736768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a3900-b0db-4aee-bd10-8e4d8f4be34e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.747374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 975/1916] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:40.748376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.760985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0f18e-cb77-492a-823e-0376f13fa247 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.765589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.766661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.767125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.767306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.767626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.767773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.767950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.768563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.769480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] PATH_INFO: `/v3/projects/04c27d6b311d4be583c6ab9d464340a2/users/922580e020f14a2a9c82027d21ca0e34/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.770964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.781321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c27d6b311d4be583c6ab9d464340a2, user_id=922580e020f14a2a9c82027d21ca0e34, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.804261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 976/1917] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:40 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:40.805593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.811267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.823641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e3d0-be0e-4c94-ac4d-949e839e3d71 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:40.834886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 942/1918] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:40 2022] PUT /identity/v3/projects/04c27d6b311d4be583c6ab9d464340a2/users/922580e020f14a2a9c82027d21ca0e34/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:40.835859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:40.960107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:40.962042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:40.962213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:40.962567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] PATH_INFO: `/v3/projects/ecb736fffa2442ba997dd1c7aa36c730/users/740ab2f6de784772a1e5926a52fa642d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:40.966945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecb736fffa2442ba997dd1c7aa36c730, user_id=740ab2f6de784772a1e5926a52fa642d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:40.972266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69d43e-fa89-45df-b5a0-d7ab1feac3bc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:40.995162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 977/1919] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:40 2022] PUT /identity/v3/projects/ecb736fffa2442ba997dd1c7aa36c730/users/740ab2f6de784772a1e5926a52fa642d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:41.013112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.018459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.018777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.029980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b081f-781f-4552-9dc6-cdcec59f21c1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:41.121419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] MFA Rules not processed for user `922580e020f14a2a9c82027d21ca0e34`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:41.123847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:41.219118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:41.224623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.227175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.227973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.229703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:41.238582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556bd64-3161-4431-b267-9d9692f6c74f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:41.269358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:41.295953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 943/1920] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:41.298482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.298977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.299444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.377373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:41.422143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 978/1921] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:41.422143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:41.423494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] MFA Rules not processed for user `740ab2f6de784772a1e5926a52fa642d`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:41.425661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:41.458419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a24d3-26f2-42e8-89d1-fb54a648e30d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:41.466698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:41.467886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.468693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.469179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.470049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:41.477159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:41.498466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 979/1922] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:41.500579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:41.504166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:41.548454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 944/1923] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:41.550042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:41.567069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4d08a-926d-496b-9374-b1ac517a1109 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:41.574615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:41.576630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.576992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.577271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] PATH_INFO: `/v3/projects/22505c512e3d4274b5a6c865fbbb6dd4/users/c6fdb5696728432db7cce78f0568f095/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.607715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22505c512e3d4274b5a6c865fbbb6dd4, user_id=c6fdb5696728432db7cce78f0568f095, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:41.613290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:41.621269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b94ed-2710-4b80-ba75-09266a836f31 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:41.625885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:41.626711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.627295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.627670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.638997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 945/1924] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:41 2022] PUT /identity/v3/projects/22505c512e3d4274b5a6c865fbbb6dd4/users/c6fdb5696728432db7cce78f0568f095/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:41.639974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:41.641460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:41.642058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:41.643619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4323b-d85f-4d3d-895a-5d7fc2fccfb0 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:41.658859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 980/1925] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:41.660707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.661193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.662131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.716656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] MFA Rules not processed for user `c6fdb5696728432db7cce78f0568f095`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:41.719153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:41.812283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93ebc1-4721-47bb-a82c-c6e26333258b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:41.819827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:41.819827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:41.820119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:41.820328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:41.860646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 981/1926] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:41.865434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.015998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ceb40-dc3e-42c2-88a5-20bc7938a84a None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.027038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.030816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.031660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.032319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.033490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.034628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.035454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.043818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.053101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 946/1927] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:42.120335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 982/1928] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:41 2022] POST /identity/v3/projects => generated 379 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:42.122426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.151404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bea2c-0b81-4946-976f-6310c53e2083 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.170368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:42.210216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.220724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:42.280709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.281399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.281676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.281956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.282636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.284950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.330754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 947/1929] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:42 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:42.333276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.351577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638420f-692e-4aa2-a5f9-dfd0ebc22630 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.367332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96304d27-1cb9-4a8a-9b56-8f5ddb369a87 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.368786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.369876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.370356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.370846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.391197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.392402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.392925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.395783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.399948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.402889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.467612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 948/1930] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:42.475196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.514733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff19d0-e017-47d7-82a0-5fa46e8849ee admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.531532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.531532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.532108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.532857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] PATH_INFO: `/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c/users/a73a0f4b75a049e8b7009fc7b35983fe/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.558513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4194dab8ae3b478eabd32dd7b2a5fb5c, user_id=a73a0f4b75a049e8b7009fc7b35983fe, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.565126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.587386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.588764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 949/1931] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:42 2022] PUT /identity/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c/users/a73a0f4b75a049e8b7009fc7b35983fe/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:42.594753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.595478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.610869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 983/1932] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:42.689360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191adc79-1ba4-4a11-a8ed-fecb0f77ca2a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.697805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.698511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.698822 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.699065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.700532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.702581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c23a-1118-489c-97c4-4d627444e171 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.717404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 950/1933] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:42.723061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:42.748349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3459282-8cdc-43ae-9df9-6fc97211728f service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:42.759092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:42.759092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.759092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.759092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] PATH_INFO: `/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c/users/a73a0f4b75a049e8b7009fc7b35983fe/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.761859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4194dab8ae3b478eabd32dd7b2a5fb5c, user_id=a73a0f4b75a049e8b7009fc7b35983fe, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:42.765965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:42.792874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 984/1934] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:42 2022] PUT /identity/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c/users/a73a0f4b75a049e8b7009fc7b35983fe/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:42.806210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:42.807162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:42.807162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:42.911419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] MFA Rules not processed for user `a73a0f4b75a049e8b7009fc7b35983fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:42.913298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:42.923355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.000903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:43.045110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 951/1935] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:43.059585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.079963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad02a-74e2-4939-8b38-4c10926d2a05 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:43.087667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:43.088425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.089104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.089104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] PATH_INFO: `/v3/users/854731041b3745379330b135524c3fde` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.090706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=854731041b3745379330b135524c3fde)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:43.093014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:43.171128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a93d7-e0c9-47c6-8eac-74c6c0ffd06b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:43.175429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:43.176123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.176407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.176684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.186069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:43.188093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854731041b3745379330b135524c3fde'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.189101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854731041b3745379330b135524c3fde'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.189933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:43.191938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62f506-7990-455a-b8d6-e82e4a78cdf0 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:43.203778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854731041b3745379330b135524c3fde'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.204353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854731041b3745379330b135524c3fde'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.206527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 952/1936] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:43.221186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854731041b3745379330b135524c3fde'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.244883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 985/1937] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:42 2022] DELETE /identity/v3/users/854731041b3745379330b135524c3fde => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:43.251388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.252099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.252619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.266730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.268789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.288445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:43.288707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.405524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db200d-517e-4289-b33e-6af0f388d59a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:43.410707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:43.411360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.411638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.412044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.416114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 953/1938] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:43.416364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.437119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.439596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.539237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:43.541631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:43.544770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a0f0c-9e50-447a-aa45-51c72e69929e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:43.549120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:43.549758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.550032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.550302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.552945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 986/1939] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:43.561409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:43.562895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af162a2c-6e86-42af-be73-23785657b867 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:43.575102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 954/1940] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:43.630751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.632280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.648310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68c06-a791-49c3-be2c-004263d5ad3b service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:43.656085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:43.657159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.657440 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.657698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] PATH_INFO: `/v3/users/7aa22d3a720247a0a2b0eb52505ff01d` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.659031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa22d3a720247a0a2b0eb52505ff01d)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:43.661129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:43.750027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa22d3a720247a0a2b0eb52505ff01d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.751103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa22d3a720247a0a2b0eb52505ff01d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.766452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa22d3a720247a0a2b0eb52505ff01d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.767259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa22d3a720247a0a2b0eb52505ff01d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.785231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa22d3a720247a0a2b0eb52505ff01d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:43.812175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:43.836543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 987/1941] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:43 2022] DELETE /identity/v3/users/7aa22d3a720247a0a2b0eb52505ff01d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:43.845323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:43.845784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:43.846231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:43.880616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:43.882021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:43.961349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:43.991048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:43.992919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:44.050325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 955/1942] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:44.067174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:44.069102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:44.106552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee12c5-064c-4897-9802-fa2e50b00bbb admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:44.113521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:44.114428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:44.114806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:44.115186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] PATH_INFO: `/v3/projects/22bfd0abdf6a4df6b8ac40832bb73756` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:44.117030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bfd0abdf6a4df6b8ac40832bb73756)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:44.127333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:44.226405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bfd0abdf6a4df6b8ac40832bb73756', 'request_id': 'req-d6218c10-7c50-4c64-8b63-113cf2cefcce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.260565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bfd0abdf6a4df6b8ac40832bb73756', 'request_id': 'req-d6218c10-7c50-4c64-8b63-113cf2cefcce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.276423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bfd0abdf6a4df6b8ac40832bb73756', 'request_id': 'req-d6218c10-7c50-4c64-8b63-113cf2cefcce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.312913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28191c9-cf54-41ac-9f54-b7cf5631fbe1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:44.322984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] The token cache is being invalidate because project 22bfd0abdf6a4df6b8ac40832bb73756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:44.323320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.327050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.332022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 988/1943] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:43 2022] DELETE /identity/v3/projects/22bfd0abdf6a4df6b8ac40832bb73756 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:44.338426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:44.341626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:44.471384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:44.473815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:44.473815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:44.474255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:44.477454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:44.531300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6218c10-7c50-4c64-8b63-113cf2cefcce admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:44.540335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:44.546260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:44.548532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:44.548957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] PATH_INFO: `/v3/users/922580e020f14a2a9c82027d21ca0e34` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:44.552256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=922580e020f14a2a9c82027d21ca0e34)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:44.555585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:44.632544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:44.676741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:44.680723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:44.711048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 956/1944] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:44.716650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922580e020f14a2a9c82027d21ca0e34'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.717489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922580e020f14a2a9c82027d21ca0e34'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.738087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922580e020f14a2a9c82027d21ca0e34'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.739182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922580e020f14a2a9c82027d21ca0e34'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.759661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922580e020f14a2a9c82027d21ca0e34'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:44.787464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 989/1945] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:44 2022] DELETE /identity/v3/users/922580e020f14a2a9c82027d21ca0e34 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:45.376080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:45.407084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a3db0-9ba9-41cb-a097-e2cfb8c0b46f service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:45.486616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:45.487509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:45.490228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:45.517051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:45.518188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:45.518643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:45.519206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] PATH_INFO: `/v3/projects/04c27d6b311d4be583c6ab9d464340a2` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:45.521268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c27d6b311d4be583c6ab9d464340a2)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:45.523737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:45.611633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c27d6b311d4be583c6ab9d464340a2', 'request_id': 'req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.619449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c27d6b311d4be583c6ab9d464340a2', 'request_id': 'req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.634197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d3b84-306d-4066-a276-442eb8d199b9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:45.639287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c27d6b311d4be583c6ab9d464340a2', 'request_id': 'req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.673250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] The token cache is being invalidate because project 04c27d6b311d4be583c6ab9d464340a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:45.673725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.674773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-e67aa5d6-aee9-42d8-ad88-a89cabbb18a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.677997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 957/1946] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:45 2022] DELETE /identity/v3/projects/04c27d6b311d4be583c6ab9d464340a2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:45.686794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e12a-d0f8-4a38-b84b-44c2218495f8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:45.687169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e12a-d0f8-4a38-b84b-44c2218495f8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:45.687612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e12a-d0f8-4a38-b84b-44c2218495f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:45.725015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-efa5e12a-d0f8-4a38-b84b-44c2218495f8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:45.727608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-efa5e12a-d0f8-4a38-b84b-44c2218495f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:45.767389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:45.768115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:45.768443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:45.768718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] PATH_INFO: `/v3/projects/bceb3b76637b48e799e1dbe31ee64385` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:45.770454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bceb3b76637b48e799e1dbe31ee64385)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:45.773696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:45.858156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:45.870677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bceb3b76637b48e799e1dbe31ee64385', 'request_id': 'req-0e822a67-5bb4-4452-b800-9122be3648d2'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.884034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bceb3b76637b48e799e1dbe31ee64385', 'request_id': 'req-0e822a67-5bb4-4452-b800-9122be3648d2'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.898433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bceb3b76637b48e799e1dbe31ee64385', 'request_id': 'req-0e822a67-5bb4-4452-b800-9122be3648d2'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.926749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 958/1947] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:45.930418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] The token cache is being invalidate because project bceb3b76637b48e799e1dbe31ee64385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:45.930688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:45.931220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:45.931823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.932051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:45.933291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:45.939840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 990/1948] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:45 2022] DELETE /identity/v3/projects/bceb3b76637b48e799e1dbe31ee64385 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:45.941264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:45.943399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:45.975245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:45.978251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:46.082319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822a67-5bb4-4452-b800-9122be3648d2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:46.088663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:46.089937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.090829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.091219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] PATH_INFO: `/v3/users/29800fb3691a4e61a015a6861644bd39` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.092969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29800fb3691a4e61a015a6861644bd39)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:46.098182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:46.198419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29800fb3691a4e61a015a6861644bd39'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.199241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29800fb3691a4e61a015a6861644bd39'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.220276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29800fb3691a4e61a015a6861644bd39'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.225826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29800fb3691a4e61a015a6861644bd39'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.256364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 959/1949] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:46.260266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:46.267328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29800fb3691a4e61a015a6861644bd39'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.301925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4fb04-2995-4d06-86ec-92320868b5d0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:46.320041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:46.325705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.327180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 991/1950] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:45 2022] DELETE /identity/v3/users/29800fb3691a4e61a015a6861644bd39 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:46.328610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:46.333029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.334086 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.338148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:46.338898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:46.343016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:46.347559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:46.365369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:46.470022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 960/1951] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:46.475339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:46.481409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:46.537915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576a6ee-369f-44af-8c9f-798e7d370b0b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:46.585181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:46.598216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ef81-72bd-4bd8-b832-ba3cb784f353 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:46.610944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:46.611621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.611903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.612183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] PATH_INFO: `/v3/users/848bed45f5ee49e6aadb8e3f84146410` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.613603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848bed45f5ee49e6aadb8e3f84146410)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:46.615699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:46.694839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:46.695703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.696180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.696553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.698215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:46.701803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:46.758361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 961/1952] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:46 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:46.763544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:46.782668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848bed45f5ee49e6aadb8e3f84146410'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.783419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848bed45f5ee49e6aadb8e3f84146410'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.802104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848bed45f5ee49e6aadb8e3f84146410'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.802947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848bed45f5ee49e6aadb8e3f84146410'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.819287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ae24c4b-ca10-4a9d-bf4e-aaef294a1572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848bed45f5ee49e6aadb8e3f84146410'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:46.871019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc96450-4f77-4228-ae26-c9021b48afb5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:46.875706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 992/1953] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:46 2022] DELETE /identity/v3/users/848bed45f5ee49e6aadb8e3f84146410 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:46.883178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.883679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.884107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.934473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:46.935791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:46.969664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:46.973667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:46.973964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:46.974289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:46.976362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:46.984942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.040744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 962/1954] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:46 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:47.047035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.050270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.080493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 993/1955] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:47.082906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e754a3c-cca0-4796-9cfb-a5d59aca3693 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.094728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.098176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.098501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.098783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.099505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.102499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.104073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.105143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.146993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 963/1956] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:24:47.157097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.170278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477aa82-4be8-4997-b389-28c0261bad75 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.176508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.177709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.178405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.178951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.179889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.181828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.202375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:47.214172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed56ff4-2df6-4fc1-91f7-7c0e7ccdf8e5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.220024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.220675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.223938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.223938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.231512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 964/1957] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:47.237610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.256713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.258698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.266335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ad02-e512-45c6-9a9b-ca7315b09878 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.272889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 994/1958] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:47.287661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.289773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.294144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.297065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] PATH_INFO: `/v3/projects/6abf0c1ad2664fa796d6a025b584a9a8/users/370f6caf87624069946c07352b29163d/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.357567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.359282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.380076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abf0c1ad2664fa796d6a025b584a9a8, user_id=370f6caf87624069946c07352b29163d, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.393201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.407729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea0e9b-f074-4f9d-a16b-0d5e03d87f21 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.417475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.418589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.421925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.423733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] PATH_INFO: `/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.425604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb5d1e1d4af48c990fe457bbfbbcb41)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.434794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 965/1959] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:47 2022] PUT /identity/v3/projects/6abf0c1ad2664fa796d6a025b584a9a8/users/370f6caf87624069946c07352b29163d/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:47.436467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.437047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.441400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.466794 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:47.572586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb5d1e1d4af48c990fe457bbfbbcb41', 'request_id': 'req-69f12eec-b346-437e-b638-6ae59f19004d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.595822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb5d1e1d4af48c990fe457bbfbbcb41', 'request_id': 'req-69f12eec-b346-437e-b638-6ae59f19004d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.611732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb5d1e1d4af48c990fe457bbfbbcb41', 'request_id': 'req-69f12eec-b346-437e-b638-6ae59f19004d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.634139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b1a5-852e-43aa-bee3-dedc9c7755fe admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:47.646870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] The token cache is being invalidate because project 9cb5d1e1d4af48c990fe457bbfbbcb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:47.647380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.648738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69f12eec-b346-437e-b638-6ae59f19004d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.651942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 995/1960] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:47 2022] DELETE /identity/v3/projects/9cb5d1e1d4af48c990fe457bbfbbcb41 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:47.656118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7dc12-9573-4566-9181-e26596fa3836 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.657255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7dc12-9573-4566-9181-e26596fa3836 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.657576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7dc12-9573-4566-9181-e26596fa3836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.691818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a6c7dc12-9573-4566-9181-e26596fa3836 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:47.693072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6c7dc12-9573-4566-9181-e26596fa3836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.761717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:47.763847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.764137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.764519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] PATH_INFO: `/v3/users/da9dba38970a4d2c8edb966bbd6e8452` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.766484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9dba38970a4d2c8edb966bbd6e8452)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:47.769352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:47.845347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 996/1961] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:47.847342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:47.847796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:47.848275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:47.882871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:47.884799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.900599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 997/1962] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:47.901586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:47.904836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:47.917577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9dba38970a4d2c8edb966bbd6e8452'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.969978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9dba38970a4d2c8edb966bbd6e8452'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.989669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9dba38970a4d2c8edb966bbd6e8452'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.992009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9dba38970a4d2c8edb966bbd6e8452'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:47.993334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3969c567-7fa0-4fbf-8e90-568a9953acb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9dba38970a4d2c8edb966bbd6e8452'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:48.011522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:48.019425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93196f-03f5-4666-9367-ad52c3461641 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.025110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 966/1963] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:47 2022] DELETE /identity/v3/users/da9dba38970a4d2c8edb966bbd6e8452 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:48.028284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.029028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.029616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.030815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.032270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.033011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.033911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.037494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:48.064960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.068135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007ba09-32fe-4533-83ab-79e7d0cf17ce service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.078883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:48.082692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:48.091835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 998/1964] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:48.095006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.095469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.096058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.135049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:48.137968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:48.215287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:48.254837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 967/1965] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:48.261155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:48.301763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f4558-011d-4a05-b064-ba5f1ecb42ee None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.317820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.319247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.319908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.320586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.322236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:48.323046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.327415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.359641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 968/1966] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:48.366562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:48.392893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9dfb7-8323-4fb6-a769-d3af49d9b0c1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.393176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 999/1967] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:48.410278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.411116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.411504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.411886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.412657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.416978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.473690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:48.474263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 969/1968] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:48 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:48.499804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a43b-4deb-44e8-9b07-7bd307551f5f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.689890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:48.693293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:48.731426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.735004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.735719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.736168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.737473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.740218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.798184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1000/1969] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:48 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:48.802051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:48.823624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:48.852643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad519b-eb99-45cf-8626-daccd7f6dfdc admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.861577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.862630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.863007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.863520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] PATH_INFO: `/v3/projects/ef7cccc2e2524db8b51ed4d7c8b1fe1c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.864935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7cccc2e2524db8b51ed4d7c8b1fe1c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.867173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.901797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b941c64-e662-4fab-9731-31fcb3b0ed65 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:48.911433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:48.914207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:48.914863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:48.915610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:48.944511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:48.956953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:48.957204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7cccc2e2524db8b51ed4d7c8b1fe1c', 'request_id': 'req-d9c2888f-02f6-4294-ae0a-a7037413585f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:48.972176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7cccc2e2524db8b51ed4d7c8b1fe1c', 'request_id': 'req-d9c2888f-02f6-4294-ae0a-a7037413585f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:48.987699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7cccc2e2524db8b51ed4d7c8b1fe1c', 'request_id': 'req-d9c2888f-02f6-4294-ae0a-a7037413585f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.005342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 970/1970] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:49.007040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:49.019540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] The token cache is being invalidate because project ef7cccc2e2524db8b51ed4d7c8b1fe1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:49.019839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.021208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.023625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1001/1971] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:48 2022] DELETE /identity/v3/projects/ef7cccc2e2524db8b51ed4d7c8b1fe1c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:49.031282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:49.037186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:49.073882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf6ea9-54c1-458c-8394-8f600cf7f032 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:49.171936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:49.201932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2888f-02f6-4294-ae0a-a7037413585f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:49.212541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:49.213636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.214104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.214558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] PATH_INFO: `/v3/users/740ab2f6de784772a1e5926a52fa642d` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.217947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740ab2f6de784772a1e5926a52fa642d)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:49.220755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:49.268580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:49.270183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.270693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.271283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.272659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:49.276350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:49.308076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 971/1972] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:49.310045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:49.318338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:49.340978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740ab2f6de784772a1e5926a52fa642d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.342031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740ab2f6de784772a1e5926a52fa642d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.347712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:49.361799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ddd8a-7de8-4bcc-b689-b83061e7799e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:49.364144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740ab2f6de784772a1e5926a52fa642d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.365663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740ab2f6de784772a1e5926a52fa642d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.389612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:49.390719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.391804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.391804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.393041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:49.404860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e43e5b8c-d478-4651-994c-38210c998d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740ab2f6de784772a1e5926a52fa642d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:49.409035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:49.462478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 972/1973] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:49.467589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:49.472323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:49.489132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1002/1974] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:49 2022] DELETE /identity/v3/users/740ab2f6de784772a1e5926a52fa642d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:49.506705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7468d9-083e-4d83-b2ec-dd803717830f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:49.674910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:49.680930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.681907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.682413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] PATH_INFO: `/v3/projects/4dde210040b245a296762afc7da22c36/users/e235e9d4c75c4dcfacb4133261222cce/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.729874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dde210040b245a296762afc7da22c36, user_id=e235e9d4c75c4dcfacb4133261222cce, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:49.739359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43159-4d2b-451b-8a60-403f4fb3db95 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:49.807493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.808104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.808450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.825922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 973/1975] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:49 2022] PUT /identity/v3/projects/4dde210040b245a296762afc7da22c36/users/e235e9d4c75c4dcfacb4133261222cce/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:49.850742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:49.851085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:49.851472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:49.937278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] MFA Rules not processed for user `e235e9d4c75c4dcfacb4133261222cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:49.938616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] MFA Rules not processed for user `370f6caf87624069946c07352b29163d`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:49.949226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:49.950347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:50.208670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 974/1976] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:50.209013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1003/1977] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:50.218629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.222631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.223699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:50.378425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc48808-d296-4544-b1e9-6cfbcd86a82d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.380851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ce4e-ea05-487e-a258-fdb4bdb614c0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.390503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:50.390876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:50.391414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:50.391707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:50.392171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:50.392373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:50.392527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:50.392672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:50.396666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:50.399902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:50.404565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:50.411138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:50.432505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:50.436734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:50.477334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 975/1978] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:50 2022] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:50.479788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.543723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1004/1979] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:50 2022] POST /identity/v3/projects => generated 389 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:50.559361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.633299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e861e-9cb5-40d3-be97-5028fec5b9ef admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.740005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:50.740691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:50.741335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:50.741850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:50.742547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:50.745511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:50.787739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 976/1980] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:50 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:50.787739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.788162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:50.806496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0018-e1d4-4a4e-964f-d913715b21ba admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.820611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:50.822528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:50.823536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:50.824261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] PATH_INFO: `/v3/projects/3987d93e16c24deabce4b7adccff4655` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:50.829216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3987d93e16c24deabce4b7adccff4655)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:50.835817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:50.858850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb4d2-4201-44e0-9cf0-02bab2618634 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.872106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:50.873892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:50.874100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:50.874290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:50.874956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:50.877648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:50.940594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1005/1981] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:50 2022] POST /identity/v3/users => generated 301 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:50.943041 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:50.948954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3987d93e16c24deabce4b7adccff4655', 'request_id': 'req-cbd4db91-14d5-46c5-ade8-cdbc020473f8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:50.962589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ab7e2-6c17-416a-b305-295ac1b66ed9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:50.963450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3987d93e16c24deabce4b7adccff4655', 'request_id': 'req-cbd4db91-14d5-46c5-ade8-cdbc020473f8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:50.973676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3987d93e16c24deabce4b7adccff4655', 'request_id': 'req-cbd4db91-14d5-46c5-ade8-cdbc020473f8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:50.999578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] The token cache is being invalidate because project 3987d93e16c24deabce4b7adccff4655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:50.999998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.001718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.013557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 977/1982] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:50 2022] DELETE /identity/v3/projects/3987d93e16c24deabce4b7adccff4655 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:51.015069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.018772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.048770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:51.105098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.107470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.108063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.108661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.110277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.113979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.147533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1006/1983] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:51.147533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.148008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4db91-14d5-46c5-ade8-cdbc020473f8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.148598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.156497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.157546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.158671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.159109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] PATH_INFO: `/v3/projects/ecb736fffa2442ba997dd1c7aa36c730` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.161884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecb736fffa2442ba997dd1c7aa36c730)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.165886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.182579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4357a42-cbbd-4001-9d02-82458a46c2a9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.192709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.193967 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.194630 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.195885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.197322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.201970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.229573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1007/1984] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:51.232247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.238130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecb736fffa2442ba997dd1c7aa36c730', 'request_id': 'req-80e7397e-3dad-4ce7-a37c-ed410707da57'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.238924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.247964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecb736fffa2442ba997dd1c7aa36c730', 'request_id': 'req-80e7397e-3dad-4ce7-a37c-ed410707da57'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.259489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecb736fffa2442ba997dd1c7aa36c730', 'request_id': 'req-80e7397e-3dad-4ce7-a37c-ed410707da57'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.265821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473ef79-a42f-422e-a8c6-5ab7ae94578e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.280730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] The token cache is being invalidate because project ecb736fffa2442ba997dd1c7aa36c730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:51.281101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.281942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.284570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 978/1985] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:51 2022] DELETE /identity/v3/projects/ecb736fffa2442ba997dd1c7aa36c730 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:51.285015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.288593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.401234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.402000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.402273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.402690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] PATH_INFO: `/v3/users/c6fdb5696728432db7cce78f0568f095` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.404201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6fdb5696728432db7cce78f0568f095)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.406642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.411042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:51.417509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7397e-3dad-4ce7-a37c-ed410707da57 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.430998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.432308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.432895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.433463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] PATH_INFO: `/v3/projects/2154cfc86ef74e84accb94fd2cc8d933/users/f0ab675d4cc54507b3d86e30aa5becc2/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.469923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2154cfc86ef74e84accb94fd2cc8d933, user_id=f0ab675d4cc54507b3d86e30aa5becc2, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.473521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.499203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 979/1986] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:51 2022] PUT /identity/v3/projects/2154cfc86ef74e84accb94fd2cc8d933/users/f0ab675d4cc54507b3d86e30aa5becc2/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:51.501686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.505371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6fdb5696728432db7cce78f0568f095'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.506873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.507497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6fdb5696728432db7cce78f0568f095'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.524617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6fdb5696728432db7cce78f0568f095'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.526381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6fdb5696728432db7cce78f0568f095'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.545642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b2bad-276c-4fd5-b83e-07e03d3ac577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6fdb5696728432db7cce78f0568f095'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:51.564374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:51.601203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1008/1987] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:51 2022] DELETE /identity/v3/users/c6fdb5696728432db7cce78f0568f095 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:51.604483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.605009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.605528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.650324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:51.653893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.698857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e1806-89bf-4fa7-9e16-5dbe8c18a3fa admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.860342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1009/1988] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:51.861949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:51.867844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.870721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:51.872737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.873411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.873879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] PATH_INFO: `/v3/projects/7c6541fb2ac041729f4cce44a4308f11/users/51ac48ec976d4630bd75de984f87c7a3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.916800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6541fb2ac041729f4cce44a4308f11, user_id=51ac48ec976d4630bd75de984f87c7a3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.919769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71643271-9ca7-42ce-ba7a-517fc7a32fd5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:51.924728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb202e-7d02-4c7c-a41b-504625f9ca2d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.941114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:51.942647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.943296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.943808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:51.945489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:51.955848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:51.967559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 980/1989] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:51 2022] PUT /identity/v3/projects/7c6541fb2ac041729f4cce44a4308f11/users/51ac48ec976d4630bd75de984f87c7a3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:51.969568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:51.970106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:51.970985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.002790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1010/1990] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:52.006632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.019559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:52.055781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:52.060374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:52.067978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82adbde2-1d10-49c8-af94-c3d62a51bdb2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.223538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.224343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.224745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.225300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.226146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.229321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.246844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1011/1991] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:52.247953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.255552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:52.264991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f8e4b-57de-49bc-9fdb-d3cdb304e65c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.284870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.291886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.293256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.294083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] PATH_INFO: `/v3/projects/2154cfc86ef74e84accb94fd2cc8d933/users/f0ab675d4cc54507b3d86e30aa5becc2/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.296166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 981/1992] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:52.297899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.304490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2154cfc86ef74e84accb94fd2cc8d933, user_id=f0ab675d4cc54507b3d86e30aa5becc2, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.312149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.318720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9b608-eb5a-493a-8127-fc3db19a2cc7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.330608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.331987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.332670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.333445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] PATH_INFO: `/v3/projects/7c6541fb2ac041729f4cce44a4308f11/users/51ac48ec976d4630bd75de984f87c7a3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.346092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6541fb2ac041729f4cce44a4308f11, user_id=51ac48ec976d4630bd75de984f87c7a3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.349725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1012/1993] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:52 2022] PUT /identity/v3/projects/2154cfc86ef74e84accb94fd2cc8d933/users/f0ab675d4cc54507b3d86e30aa5becc2/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:52.352641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.358817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1bbac-192a-40a7-8942-a9d936c5e56c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.414095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 982/1994] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:52 2022] PUT /identity/v3/projects/7c6541fb2ac041729f4cce44a4308f11/users/51ac48ec976d4630bd75de984f87c7a3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:52.428382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.429586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.430951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.544651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] MFA Rules not processed for user `51ac48ec976d4630bd75de984f87c7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:52.549680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:52.565579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ad4d0-4f85-4d5e-9122-946efd6cb3c1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.654473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:52.726233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.727631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.728073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.728522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.729682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:52.730219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.734998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.764986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 983/1995] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:52 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:52.766552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1013/1996] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:52.770909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.775109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.778254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:52.817211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e67d-36fe-4158-9cc4-41812ea9245c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.837202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.837853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.838150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.838501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.839176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.842087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.910945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3658df-4f13-4240-88fe-6fc0af870794 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:52.916689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:52.917849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:52.919381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:52.920065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:52.937481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:52.939900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:52.944224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 984/1997] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:52 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:52.945452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:52.952447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:52.975162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1014/1998] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:52 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:52.978785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:53.005581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d71a5-bda5-4744-a762-d394d11832e3 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:53.097564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:53.158850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2176e1-8183-4b5c-920c-caa539bfa712 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:53.187296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:53.188234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.188707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.189061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] PATH_INFO: `/v3/projects/22505c512e3d4274b5a6c865fbbb6dd4` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.191071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22505c512e3d4274b5a6c865fbbb6dd4)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:53.194654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:53.196333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:53.197704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.198061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.198341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.198991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:53.204070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:53.245560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1015/1999] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:52 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:53.245560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:53.265834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede2ec3-703f-432a-89d9-d2cb50ed498b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:53.274999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:53.276723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.278291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.280701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] PATH_INFO: `/v3/users/e235e9d4c75c4dcfacb4133261222cce` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.283033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e235e9d4c75c4dcfacb4133261222cce)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:53.286130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:53.367473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22505c512e3d4274b5a6c865fbbb6dd4', 'request_id': 'req-71669f09-e836-4edc-8356-90cb00e1a706'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.387672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22505c512e3d4274b5a6c865fbbb6dd4', 'request_id': 'req-71669f09-e836-4edc-8356-90cb00e1a706'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.413080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22505c512e3d4274b5a6c865fbbb6dd4', 'request_id': 'req-71669f09-e836-4edc-8356-90cb00e1a706'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.423933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e235e9d4c75c4dcfacb4133261222cce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.425386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e235e9d4c75c4dcfacb4133261222cce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.437523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] The token cache is being invalidate because project 22505c512e3d4274b5a6c865fbbb6dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:53.438472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.441690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e235e9d4c75c4dcfacb4133261222cce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.442674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e235e9d4c75c4dcfacb4133261222cce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.444991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.446738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 985/2000] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:52 2022] DELETE /identity/v3/projects/22505c512e3d4274b5a6c865fbbb6dd4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:53.452072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:53.453685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:53.455002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e235e9d4c75c4dcfacb4133261222cce'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.512543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1016/2001] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:53 2022] DELETE /identity/v3/users/e235e9d4c75c4dcfacb4133261222cce => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:53.515475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:53.518928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:53.636021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284da2-37be-4bd4-818a-81456dd036d7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:53.642729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:53.643617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.643997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.644384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] PATH_INFO: `/v3/users/a73a0f4b75a049e8b7009fc7b35983fe` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.648335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:53.649707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73a0f4b75a049e8b7009fc7b35983fe)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:53.654439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:53.814238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71669f09-e836-4edc-8356-90cb00e1a706 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:53.817828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:53.845918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:53.846394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73a0f4b75a049e8b7009fc7b35983fe'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.846916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.848205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73a0f4b75a049e8b7009fc7b35983fe'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.854643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.855130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.857046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:53.860851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad44c9-5885-4476-892f-d98789c32aae admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:53.903512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73a0f4b75a049e8b7009fc7b35983fe'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.904838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73a0f4b75a049e8b7009fc7b35983fe'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:53.920922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 986/2002] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:53.923431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daaa4-b143-4996-a761-b3505169197e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:53.923883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daaa4-b143-4996-a761-b3505169197e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:53.924332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037daaa4-b143-4996-a761-b3505169197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:53.947560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73a0f4b75a049e8b7009fc7b35983fe'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:54.005598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-037daaa4-b143-4996-a761-b3505169197e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:54.007855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-037daaa4-b143-4996-a761-b3505169197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:54.044352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 987/2003] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:54.045992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037daaa4-b143-4996-a761-b3505169197e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:54.051189 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1017/2004] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:53 2022] DELETE /identity/v3/users/a73a0f4b75a049e8b7009fc7b35983fe => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:54.053188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-037daaa4-b143-4996-a761-b3505169197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:54.096398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037daaa4-b143-4996-a761-b3505169197e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:54.103976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:54.108330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:54.228397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:54.229255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:54.229394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:54.229870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:54.231183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:54.234352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:54.256689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 988/2005] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:54.263560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:54.291785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184686-a299-4b98-84e6-e1160a24022e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:54.302641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:54.303342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:54.303626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:54.304010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] PATH_INFO: `/v3/projects/10b41c9dc81740b89690c6ab61e78ebc/users/d6df126bc26c489d837a7e7fb0d30d8b/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:54.312981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03807650-0c2f-40ae-963e-b646ea46fb1a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:54.325878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:54.327785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:54.328660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:54.329547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:54.352068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b41c9dc81740b89690c6ab61e78ebc, user_id=d6df126bc26c489d837a7e7fb0d30d8b, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:54.352991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:54.355057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68656b-5477-47f1-a9b2-cc099e726737 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:54.358371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:54.403920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 989/2006] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:54 2022] PUT /identity/v3/projects/10b41c9dc81740b89690c6ab61e78ebc/users/d6df126bc26c489d837a7e7fb0d30d8b/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:54.425364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1018/2007] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:54.430749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:54.431296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:54.431743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:54.493627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] MFA Rules not processed for user `d6df126bc26c489d837a7e7fb0d30d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:54.495932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:54.656374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 990/2008] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:54.662640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:54.692035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9476-c072-41d5-8d24-7160806977fe service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:54.868718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:54.869820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:54.870289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:54.870727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:54.872366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:54.876183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:54.935854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1019/2009] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:54 2022] POST /identity/v3/projects => generated 381 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:24:54.939568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:54.959194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd93788-a707-4983-91e1-b7c0a69c484a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.021642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:55.114154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.116161 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.116779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.117526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.119241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.123759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:55.184277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 991/2010] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:54 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:55.190430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:55.208541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53889752-a580-4bce-918d-1044d78a6370 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.215411 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.216668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.217298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.217880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.219150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.222114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:55.245292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1020/2011] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:55.250095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:55.265228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb36a8d-a1e1-455f-8473-494b7e58da42 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.271376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.272949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.273886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.275124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] PATH_INFO: `/v3/projects/b0be5bf34f5842418a33b24976d7bcdb/users/be86eee792e543e588f9d8592bbb830b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.310068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0be5bf34f5842418a33b24976d7bcdb, user_id=be86eee792e543e588f9d8592bbb830b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.321552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:55.352677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:55.354728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 992/2012] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:55 2022] PUT /identity/v3/projects/b0be5bf34f5842418a33b24976d7bcdb/users/be86eee792e543e588f9d8592bbb830b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:55.356406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:55.373462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:55.374503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e3e1f-6869-4c25-b29a-d9f902458aaa admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.425351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:55.474566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.475228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.475504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.475773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] PATH_INFO: `/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.477053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4194dab8ae3b478eabd32dd7b2a5fb5c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.479464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:55.565499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4194dab8ae3b478eabd32dd7b2a5fb5c', 'request_id': 'req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:55.585575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4194dab8ae3b478eabd32dd7b2a5fb5c', 'request_id': 'req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:55.610147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4194dab8ae3b478eabd32dd7b2a5fb5c', 'request_id': 'req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:55.624211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ac979-901f-4928-a158-45c2eb20ac93 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.646125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] The token cache is being invalidate because project 4194dab8ae3b478eabd32dd7b2a5fb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:55.647421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:55.651227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-96b1cebf-953b-47ec-9aad-5dfcc606a0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:55.664980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1021/2013] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:55 2022] DELETE /identity/v3/projects/4194dab8ae3b478eabd32dd7b2a5fb5c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:24:55.670204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9576-7ad9-44f0-ad6b-09a3631c9ca9 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.670886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9576-7ad9-44f0-ad6b-09a3631c9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.671450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9576-7ad9-44f0-ad6b-09a3631c9ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.743945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-460f9576-7ad9-44f0-ad6b-09a3631c9ca9 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:55.749253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-460f9576-7ad9-44f0-ad6b-09a3631c9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:55.829662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.830405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.830745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.830944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.831696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.833641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:55.866385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 993/2014] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:24:55.867419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:55.875022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:55.915015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8529e-71cd-4afc-8809-e2d753cf740e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:55.934519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:55.934968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:55.935132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:55.935632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] PATH_INFO: `/v3/projects/4dde210040b245a296762afc7da22c36` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:55.940929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dde210040b245a296762afc7da22c36)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:55.948010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:56.049318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:56.082643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1022/2015] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:56.087492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daaf36-117a-4671-beba-c0deb5e44442 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.087974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daaf36-117a-4671-beba-c0deb5e44442 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.088462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daaf36-117a-4671-beba-c0deb5e44442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.091114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dde210040b245a296762afc7da22c36', 'request_id': 'req-442dda34-992e-4f6c-887c-067e45c13a9b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.113935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dde210040b245a296762afc7da22c36', 'request_id': 'req-442dda34-992e-4f6c-887c-067e45c13a9b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.121251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dde210040b245a296762afc7da22c36', 'request_id': 'req-442dda34-992e-4f6c-887c-067e45c13a9b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.163720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-14daaf36-117a-4671-beba-c0deb5e44442 None None] MFA Rules not processed for user `f0ab675d4cc54507b3d86e30aa5becc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:56.166068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-14daaf36-117a-4671-beba-c0deb5e44442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:56.187260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] The token cache is being invalidate because project 4dde210040b245a296762afc7da22c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:56.187785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.190609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.196241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 994/2016] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:55 2022] DELETE /identity/v3/projects/4dde210040b245a296762afc7da22c36 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:56.199656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:56.202936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:56.377352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:56.484560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1023/2017] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:56.511875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920e39-c4ec-49b2-a9f1-bce9bcae0329 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.512400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920e39-c4ec-49b2-a9f1-bce9bcae0329 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.513447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7920e39-c4ec-49b2-a9f1-bce9bcae0329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.527167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dda34-992e-4f6c-887c-067e45c13a9b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:56.544526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:56.545872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.546904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.546904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] PATH_INFO: `/v3/projects/b0be5bf34f5842418a33b24976d7bcdb/users/be86eee792e543e588f9d8592bbb830b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.554022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0be5bf34f5842418a33b24976d7bcdb, user_id=be86eee792e543e588f9d8592bbb830b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:56.562685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:56.586889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b7920e39-c4ec-49b2-a9f1-bce9bcae0329 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:56.589638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b7920e39-c4ec-49b2-a9f1-bce9bcae0329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:56.596941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 995/2018] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:56 2022] PUT /identity/v3/projects/b0be5bf34f5842418a33b24976d7bcdb/users/be86eee792e543e588f9d8592bbb830b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:56.598908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:56.610113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:56.720045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1024/2019] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:56.725989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252340b-fdb4-47ea-aad2-0ce3700e3fe0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.726620 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252340b-fdb4-47ea-aad2-0ce3700e3fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.727394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252340b-fdb4-47ea-aad2-0ce3700e3fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.755275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd4284-19bb-462c-bcb2-06f3ff763bb8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:56.764031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1252340b-fdb4-47ea-aad2-0ce3700e3fe0 None None] MFA Rules not processed for user `370f6caf87624069946c07352b29163d`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:56.764846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:56.765605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.765886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.766160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] PATH_INFO: `/v3/users/51ac48ec976d4630bd75de984f87c7a3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.766953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1252340b-fdb4-47ea-aad2-0ce3700e3fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:56.768124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ac48ec976d4630bd75de984f87c7a3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:56.770893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:56.880105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ac48ec976d4630bd75de984f87c7a3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.889503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:56.904296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ac48ec976d4630bd75de984f87c7a3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.921015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ac48ec976d4630bd75de984f87c7a3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.927397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ac48ec976d4630bd75de984f87c7a3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.929336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ac48ec976d4630bd75de984f87c7a3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:56.934809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1025/2020] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:56.936647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:56.937032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:56.937379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:56.966781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 996/2021] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:56 2022] DELETE /identity/v3/users/51ac48ec976d4630bd75de984f87c7a3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:56.967631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:56.969554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.029876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] MFA Rules not processed for user `be86eee792e543e588f9d8592bbb830b`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:57.032572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.248415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1026/2022] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:57.252383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c66a-5111-447f-b345-39dbe874e129 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:57.252700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:57.258027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.282514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:57.286786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:57.287365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:57.287852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:57.296070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:57.296828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:57.298925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:57.312853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:57.402979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 997/2023] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:57.402979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:57.425809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.548862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70c8f1-5c21-4630-a8c6-9fe68ac19f64 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:57.578151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:57.578151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:57.578151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:57.578627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:57.584280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.672753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226529-5336-42a0-8651-a8cafc03d6b3 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:57.694325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:57.695050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:57.695331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:57.695641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:57.711947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:57.713370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:57.760182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 998/2024] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:57.769701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:57.779837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:57.787099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:57.803834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a90cec-997b-4429-b1a1-8325af5a455b service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:57.817404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1027/2025] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:57.818550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:57.825731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:57.832260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:57.833430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:57.833863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:57.834340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:57.835497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:57.842011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:57.867549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c9852-2d4e-405a-bacf-af810ddebfc8 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:57.888390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:57.892465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:57.892792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:57.893140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] PATH_INFO: `/v3/projects/7c6541fb2ac041729f4cce44a4308f11` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:57.898336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6541fb2ac041729f4cce44a4308f11)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:57.901144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:57.964787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 999/2026] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:57 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:57.968051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.010097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6541fb2ac041729f4cce44a4308f11', 'request_id': 'req-c78359ed-5390-42ce-8f2f-c07f9a90379c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:58.031227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6541fb2ac041729f4cce44a4308f11', 'request_id': 'req-c78359ed-5390-42ce-8f2f-c07f9a90379c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:58.045608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6541fb2ac041729f4cce44a4308f11', 'request_id': 'req-c78359ed-5390-42ce-8f2f-c07f9a90379c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:58.082726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] The token cache is being invalidate because project 7c6541fb2ac041729f4cce44a4308f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:24:58.083202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:58.084304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:58.087249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1028/2027] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:24:57 2022] DELETE /identity/v3/projects/7c6541fb2ac041729f4cce44a4308f11 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:58.088597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.090987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.113263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:58.147139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637582-4ec6-4f78-a418-b9bf48e88ce0 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.192361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:58.239149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78359ed-5390-42ce-8f2f-c07f9a90379c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.254609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.256118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.256730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.257681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.261958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.296546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.297924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.298432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.298901 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.299737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.302116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aeb39-9789-4aad-a69e-6ed0b0b8023d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.337307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1000/2028] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:57 2022] POST /identity/v3/users => generated 287 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:58.340476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.341196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.342155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.377946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:58.380286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.394033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1001/2029] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:58.395197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.409233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.428857 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f97b5-eb31-45b4-9d73-81e95a2d964d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.438947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.440666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.441609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.442221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.442656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.443622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.444162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.446247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768bf383-2b6a-47f7-aab8-527dfad0a4ea admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.467347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1002/2030] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:58.470913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1029/2031] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:58.471469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.472195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.472750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.472910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.499793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ba47b-fbea-474c-9f47-fbd9bae15b3c service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.503552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:58.505896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.510552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.511613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.512154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.512800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.514083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.517783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.519099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1003/2032] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:58.525414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.540152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1030/2033] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:58.549794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991c621-9fce-4b5e-9484-1b3dc51de6aa None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.554005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.557585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.558647 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.559822 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.561837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.562620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:24:58.562938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.565109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.582411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1004/2034] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:24:58.593830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.594152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa00d07-a486-4882-a7d3-4b46f1af9936 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.610611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.613446 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb286d-f3fd-430d-bf89-f077790579b9 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.615271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.615555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.615913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] PATH_INFO: `/v3/projects/217ff12738de449188bb46a6e80266a0/users/ea93b15bebdb4bd2843719a9511f6101/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.633671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:58.635144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.637345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.637859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.639666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.643585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217ff12738de449188bb46a6e80266a0, user_id=ea93b15bebdb4bd2843719a9511f6101, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:58.644029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.647543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9869a-af89-4d46-8cbd-96b7cc83b166 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:58.683330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1031/2035] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:58 2022] PUT /identity/v3/projects/217ff12738de449188bb46a6e80266a0/users/ea93b15bebdb4bd2843719a9511f6101/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:58.692300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:58.692912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:58.693624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:58.747767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1005/2036] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:24:58 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:58.758295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:58.799237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] MFA Rules not processed for user `ea93b15bebdb4bd2843719a9511f6101`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:58.804329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:58.992111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f66a8-6c6a-41d9-af32-7da533b651e8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:58.999812 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.000838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.000982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.001444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.001879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.013602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.064098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1006/2037] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:24:58 2022] POST /identity/v3/users => generated 284 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:24:59.072274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.087011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bea7cf-154e-4411-83d6-090be3ae5474 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.112585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.113655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.114204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.114947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.116097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.119006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.128077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1032/2038] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:24:59.128077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.133923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.144233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1007/2039] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:24:59.145310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.159283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.169287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:59.188991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd29dd-cbcb-45f7-a3fc-20dca469e40c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.196216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.197946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.198731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.199496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] PATH_INFO: `/v3/users/d6df126bc26c489d837a7e7fb0d30d8b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.201670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6df126bc26c489d837a7e7fb0d30d8b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.204610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.295255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b62890-a52a-4d33-a587-3c1a9cadcb87 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.297981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:59.303553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6df126bc26c489d837a7e7fb0d30d8b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:59.305303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6df126bc26c489d837a7e7fb0d30d8b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:59.312491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.313770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.315816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.316314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.328003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6df126bc26c489d837a7e7fb0d30d8b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:59.333810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6df126bc26c489d837a7e7fb0d30d8b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:59.341644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.344695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.357811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-735d8564-3360-44c8-97a6-51c60afa392d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6df126bc26c489d837a7e7fb0d30d8b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:24:59.372124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1008/2040] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:59.373792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.393050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1033/2041] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:24:59 2022] DELETE /identity/v3/users/d6df126bc26c489d837a7e7fb0d30d8b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:59.405070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ebf83-dd62-402c-82a0-280d95a280d3 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.407371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.407748 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.408602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.481844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:59.483117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.583434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.584588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.585090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.586596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.588061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.592681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.619795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1009/2042] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:24:59.627373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.634799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.656048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1034/2043] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:59.658287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb16f1f-17ad-426e-a232-3e604650135b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.666836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.667642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.667975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.668257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] PATH_INFO: `/v3/projects/08577e6a34fa4b728c3904fef33ecd5a/users/fa02b37c204246168d0ae311c166225e/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.671957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:59.678839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.710662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=08577e6a34fa4b728c3904fef33ecd5a, user_id=fa02b37c204246168d0ae311c166225e, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:59.715356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198126f-2101-473e-a033-166cd73b19ea admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:59.756858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1010/2044] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:24:59 2022] PUT /identity/v3/projects/08577e6a34fa4b728c3904fef33ecd5a/users/fa02b37c204246168d0ae311c166225e/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:24:59.765703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.766778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.767254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:59.815435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed14203-c308-43da-8fbc-3909caa3be38 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:59.828740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] MFA Rules not processed for user `fa02b37c204246168d0ae311c166225e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:59.830256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:59.970225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:59.971412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:59.971696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:59.971994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.064029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:00.115742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1011/2045] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:24:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:00.119660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.143478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:00.155863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.159754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:00.198940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1035/2046] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:00.262583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20116149-e85d-4712-b4d9-5db64063c27f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:00.269270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:00.269946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:00.270348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:00.270871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.271885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.274116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:00.335088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1012/2047] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:00 2022] POST /identity/v3/projects => generated 365 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:00.340056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.365138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c1a21-58ae-477b-a85c-5fd4dc2ba948 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:00.561111 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:00.561843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:00.562185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:00.562449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.563380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.575459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:00.625438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1036/2048] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:00 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:00.630866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.649833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72dc82d-850a-4499-abb5-63d7690b4bd2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:00.658622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:00.660091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:00.660643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:00.661336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.662164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.664673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:00.691263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1013/2049] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:00.698308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.719412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542406d-38cf-41f2-98d6-99e2aa17e52e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:00.731292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:00.732422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:00.732592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:00.733048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] PATH_INFO: `/v3/projects/df6e4fdc1db1406ab32b1a3b44744527/users/0c969bcc4992410781bba5327719984d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.768842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6e4fdc1db1406ab32b1a3b44744527, user_id=0c969bcc4992410781bba5327719984d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.774487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:00.807950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1037/2050] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:00 2022] PUT /identity/v3/projects/df6e4fdc1db1406ab32b1a3b44744527/users/0c969bcc4992410781bba5327719984d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:00.816032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.838926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358177c1-e39e-40b8-80b2-5dfe8b9bb8c3 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:00.934919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:00.938129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:00.986600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:00.987940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:00.988462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:00.989129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:00.990594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:00.994081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:01.024183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1014/2051] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:01.028276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:01.049527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21098e21-5c5a-4d78-9123-2f195f4c0833 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:01.060023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:01.062001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.062867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.063505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] PATH_INFO: `/v3/projects/df6e4fdc1db1406ab32b1a3b44744527/users/0c969bcc4992410781bba5327719984d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.067875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6e4fdc1db1406ab32b1a3b44744527, user_id=0c969bcc4992410781bba5327719984d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:01.074251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d77d5-6a2c-4eef-86a1-a7c37760c823 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:01.102247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1015/2052] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:01 2022] PUT /identity/v3/projects/df6e4fdc1db1406ab32b1a3b44744527/users/0c969bcc4992410781bba5327719984d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:01.112082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1a4e-ec4d-4163-9d62-a964b38efe6b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:01.122758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.123184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.123561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.206020 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] MFA Rules not processed for user `0c969bcc4992410781bba5327719984d`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:01.208848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.222509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:01.260580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:01.262330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.262961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.264860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] PATH_INFO: `/v3/projects/10b41c9dc81740b89690c6ab61e78ebc` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.265592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b41c9dc81740b89690c6ab61e78ebc)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:01.268999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:01.313458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:01.353336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1016/2053] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:01.353552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b41c9dc81740b89690c6ab61e78ebc', 'request_id': 'req-578e4124-bad2-4804-826f-6e6382042812'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.364410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b41c9dc81740b89690c6ab61e78ebc', 'request_id': 'req-578e4124-bad2-4804-826f-6e6382042812'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.370037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:01.373272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.373834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b41c9dc81740b89690c6ab61e78ebc', 'request_id': 'req-578e4124-bad2-4804-826f-6e6382042812'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.391294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] The token cache is being invalidate because project 10b41c9dc81740b89690c6ab61e78ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:01.392506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.393957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.397126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1038/2054] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:00 2022] DELETE /identity/v3/projects/10b41c9dc81740b89690c6ab61e78ebc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:01.406262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:01.408783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.461793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2523189-d0f3-4f7b-a373-19618f2d43a8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:01.508762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e4124-bad2-4804-826f-6e6382042812 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:01.514296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:01.515255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.515548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.515858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] PATH_INFO: `/v3/users/be86eee792e543e588f9d8592bbb830b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.517119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be86eee792e543e588f9d8592bbb830b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:01.519123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:01.530434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:01.531060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.531342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.531612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.533827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.611791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be86eee792e543e588f9d8592bbb830b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.612510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be86eee792e543e588f9d8592bbb830b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.624091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be86eee792e543e588f9d8592bbb830b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.624830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be86eee792e543e588f9d8592bbb830b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.636545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be86eee792e543e588f9d8592bbb830b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:01.646064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:01.648136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:01.654641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:01.668256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1017/2055] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:01.680327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1039/2056] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:01 2022] DELETE /identity/v3/users/be86eee792e543e588f9d8592bbb830b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:01.876495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:01.880465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.896065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc42e6-d4f3-41dc-9b42-565b8e75f29d service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:01.962046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:01.962895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:01.963182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:01.963464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:01.966023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:01.979232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:02.052465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:02.054227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814b700-0a13-4a2c-9539-3b755f801b4e service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:02.067660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1018/2057] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:02.224120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:02.226916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:02.380012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bed83-3dd1-43e1-ac33-09473b1cd266 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:02.405985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:02.407018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:02.407493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:02.408037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] PATH_INFO: `/v3/projects/b0be5bf34f5842418a33b24976d7bcdb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:02.410616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0be5bf34f5842418a33b24976d7bcdb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:02.414580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:02.560753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0be5bf34f5842418a33b24976d7bcdb', 'request_id': 'req-e70b849c-048e-4cd2-a9bc-05c3e2083357'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:02.577452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0be5bf34f5842418a33b24976d7bcdb', 'request_id': 'req-e70b849c-048e-4cd2-a9bc-05c3e2083357'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:02.586486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0be5bf34f5842418a33b24976d7bcdb', 'request_id': 'req-e70b849c-048e-4cd2-a9bc-05c3e2083357'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:02.600545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] The token cache is being invalidate because project b0be5bf34f5842418a33b24976d7bcdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:02.601034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:02.601964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e70b849c-048e-4cd2-a9bc-05c3e2083357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:02.604112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1040/2058] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:02 2022] DELETE /identity/v3/projects/b0be5bf34f5842418a33b24976d7bcdb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:02.611513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:02.612471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:02.613009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:02.645359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:02.647097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:02.784841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1019/2059] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:02.787304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:02.787599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:02.787883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:02.819514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:02.821135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:02.836151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1041/2060] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:02.842170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:02.861487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c414b-3be6-4904-b7f9-ac0297ed4141 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:02.870506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:02.872118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:02.872607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:02.873102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:02.874436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:02.874952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:02.877873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:02.908590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1020/2061] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:02.909877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:02.921315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f66c4-5139-4ddd-b558-22adea0891b7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:02.926710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:02.927346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:02.927629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:02.928144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:02.928822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:02.930862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:02.983188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1042/2062] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:02 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:02.985717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:02.999492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2272d35-2b8a-40d4-a02a-75a89bbc7c95 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:03.073181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:03.073894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.074252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.074568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.075318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:03.077715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:03.103445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1021/2063] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:02 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:03.108696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:03.124252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dda7d-c076-4715-9538-0d453b81bad7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:03.132407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:03.133149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.133495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.133808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.134535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:03.136462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:03.148719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1043/2064] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:03.154056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:03.166624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95aab6-ed6f-46ba-9068-fc6f13e87735 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:03.173781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:03.174333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.174688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.174968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.175734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:03.177429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f98c08-fd91-470f-86b7-a8392e1f503c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:03.194443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1022/2065] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:03.199904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:03.211787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb16e0-ed2a-46af-bbe7-f2426a899895 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:03.217186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:03.218053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.218265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.218522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] PATH_INFO: `/v3/projects/1eaab2ca082f40fb81da3d40778b1850/users/d6d4cdcf72ef46528ebaf22239df03e5/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.240679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eaab2ca082f40fb81da3d40778b1850, user_id=d6d4cdcf72ef46528ebaf22239df03e5, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:03.244099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:03.263110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1044/2066] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:03 2022] PUT /identity/v3/projects/1eaab2ca082f40fb81da3d40778b1850/users/d6d4cdcf72ef46528ebaf22239df03e5/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:03.281876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.282344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.282715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.323770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] MFA Rules not processed for user `d6d4cdcf72ef46528ebaf22239df03e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:03.325825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:03.330341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:03.460088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1023/2067] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:03.469926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:03.471985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:03.521579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:03.613395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49052b9-5a05-4b46-a0dc-f237c5046510 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:03.621846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:03.623507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:03.623976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:03.624445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:03.646179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:03.649123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803356a-6cd3-449e-bb77-3b1a37132d5b service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:03.669259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1045/2068] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:09.298008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:09.300306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:09.481981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0432a79-c8ac-4c33-b972-9271a85c2dfc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:09.494546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:09.495839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:09.496498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:09.496951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] PATH_INFO: `/v3/users/fa02b37c204246168d0ae311c166225e` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:09.504175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa02b37c204246168d0ae311c166225e)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:09.504417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:09.588489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa02b37c204246168d0ae311c166225e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:09.618530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa02b37c204246168d0ae311c166225e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:09.632973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa02b37c204246168d0ae311c166225e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:09.634309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa02b37c204246168d0ae311c166225e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:09.635191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa02b37c204246168d0ae311c166225e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:09.655359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1024/2069] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:09 2022] DELETE /identity/v3/users/fa02b37c204246168d0ae311c166225e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:09.660335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:09.660997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:09.660997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:09.689268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:09.691229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:09.793711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1046/2070] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:09.805817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:09.807611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:09.848655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:09.904317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440d627-a1c4-4b79-a8de-09d141675c72 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:09.908323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:09.909554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:09.909554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:09.909554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:09.920681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:09.922431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:09.933961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1025/2071] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:10.500507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:10.503015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:10.533173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48ec49-4527-4336-b6e5-3fa7f0c9ed03 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:10.545505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:10.546907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:10.547404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:10.548011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] PATH_INFO: `/v3/projects/08577e6a34fa4b728c3904fef33ecd5a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:10.550538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08577e6a34fa4b728c3904fef33ecd5a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:10.556366 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:10.633641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08577e6a34fa4b728c3904fef33ecd5a', 'request_id': 'req-e283244a-6dfc-4f76-b396-d16d8b77b125'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.654797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08577e6a34fa4b728c3904fef33ecd5a', 'request_id': 'req-e283244a-6dfc-4f76-b396-d16d8b77b125'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.667286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08577e6a34fa4b728c3904fef33ecd5a', 'request_id': 'req-e283244a-6dfc-4f76-b396-d16d8b77b125'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.701422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] The token cache is being invalidate because project 08577e6a34fa4b728c3904fef33ecd5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:10.702035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.703655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.711342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1047/2072] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:10 2022] DELETE /identity/v3/projects/08577e6a34fa4b728c3904fef33ecd5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:10.712661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:10.725203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ddbbf-27d8-4d79-b417-e0eccf401e4c service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:10.830380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:10.831047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:10.831523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:10.831904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] PATH_INFO: `/v3/users/0c969bcc4992410781bba5327719984d` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:10.834215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c969bcc4992410781bba5327719984d)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:10.836310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:10.943805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c969bcc4992410781bba5327719984d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.965137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c969bcc4992410781bba5327719984d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.977700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c969bcc4992410781bba5327719984d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.978628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c969bcc4992410781bba5327719984d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:10.979406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-36c9eb7d-1f1e-4067-afa5-0f249927796d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c969bcc4992410781bba5327719984d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.001459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1026/2073] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:10 2022] DELETE /identity/v3/users/0c969bcc4992410781bba5327719984d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:11.589590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:11.594247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:11.617784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283244a-6dfc-4f76-b396-d16d8b77b125 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:11.684033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:11.709118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:11.709790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:11.710072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:11.710351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] PATH_INFO: `/v3/projects/df6e4fdc1db1406ab32b1a3b44744527` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:11.711654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6e4fdc1db1406ab32b1a3b44744527)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:11.713699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:11.779656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6e4fdc1db1406ab32b1a3b44744527', 'request_id': 'req-197b6c6d-c596-4773-b6bf-abb7f04f9fef'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.797066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6e4fdc1db1406ab32b1a3b44744527', 'request_id': 'req-197b6c6d-c596-4773-b6bf-abb7f04f9fef'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.809387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6e4fdc1db1406ab32b1a3b44744527', 'request_id': 'req-197b6c6d-c596-4773-b6bf-abb7f04f9fef'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.823583 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] The token cache is being invalidate because project df6e4fdc1db1406ab32b1a3b44744527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:11.823869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.824864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:11.826902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1048/2074] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:11 2022] DELETE /identity/v3/projects/df6e4fdc1db1406ab32b1a3b44744527 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:11.838188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa241a8-7303-4f8b-91da-76f7d79315ea None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:11.839045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa241a8-7303-4f8b-91da-76f7d79315ea None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:11.839045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa241a8-7303-4f8b-91da-76f7d79315ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:11.849158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:11.850662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:11.869132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7aa241a8-7303-4f8b-91da-76f7d79315ea None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:11.870470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7aa241a8-7303-4f8b-91da-76f7d79315ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:11.935813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:11.967387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6c6d-c596-4773-b6bf-abb7f04f9fef admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:11.976020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:11.977131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:11.977610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:11.977865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1027/2075] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:11.978328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] PATH_INFO: `/v3/users/d6d4cdcf72ef46528ebaf22239df03e5` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:11.980850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d4cdcf72ef46528ebaf22239df03e5)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:11.984403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:11.987755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:11.988676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:11.989154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.026801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:12.033070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:12.044866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1028/2076] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:12.055629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.081604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad4b44-0702-46e9-bd15-78232af1d63e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.101560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.104017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.104729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.106015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.107666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:12.108168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.111353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.127573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d4cdcf72ef46528ebaf22239df03e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:12.131221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d4cdcf72ef46528ebaf22239df03e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:12.142599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1029/2077] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:12.145316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.160666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d4cdcf72ef46528ebaf22239df03e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:12.162026 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d4cdcf72ef46528ebaf22239df03e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:12.167544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e27cd-4ba8-4bec-9253-46fad164c66d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.179305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.180368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.180849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.181467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d329ed4-8713-4291-a056-f78b2969bf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d4cdcf72ef46528ebaf22239df03e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:12.181675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.182908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.190867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.201178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:12.229640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1049/2078] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:11 2022] DELETE /identity/v3/users/d6d4cdcf72ef46528ebaf22239df03e5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:12.236502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.237374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.238782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.280986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:12.282889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:12.300745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1030/2079] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:12 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:12.302589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.305588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:12.435709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1050/2080] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:12.457182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.457182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:12.503572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc38a-3af6-439e-8214-df30badd49d5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.509302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.509936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.510392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.510570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.511327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.514105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.549693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1031/2081] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:12 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:12.556751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.557150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbe7e2-085a-4583-b8fc-466498e0ff52 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.562701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.563381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.563683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.563997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.579413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad2c39-230c-4f59-8e06-168f8dcaaaef admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.583313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.586238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.592927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.596404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.597102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.597393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.598528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.601845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.610838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1051/2082] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:12.635926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1032/2083] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:12.639642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.662115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbf968-238a-4bdb-b44c-663daf28b42b service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.670112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.670760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.671052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.671369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.672075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.673920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dfa25-97c0-4c61-a158-fd294647b197 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.694631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1052/2084] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:12.700852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:12.723840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0ed10-66d2-4638-9247-1c84ce0e3ef1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:12.733928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:12.735224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.735464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.735963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] PATH_INFO: `/v3/projects/998dea45ca994174be483492001bd47a/users/a15ec544d3734490bd7165f3a84e7e55/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.765119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=998dea45ca994174be483492001bd47a, user_id=a15ec544d3734490bd7165f3a84e7e55, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:12.768476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:12.786802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1033/2085] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:12 2022] PUT /identity/v3/projects/998dea45ca994174be483492001bd47a/users/a15ec544d3734490bd7165f3a84e7e55/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:12.803298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:12.803815 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:12.804285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:12.894000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] MFA Rules not processed for user `a15ec544d3734490bd7165f3a84e7e55`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:12.896342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:13.048517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1053/2086] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:13.054055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.192355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644a6d-c106-4556-b575-4b00652c5368 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.201559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.202365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.202805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.203232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.204022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.206934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.215359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:13.254399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1034/2087] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:13 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:13.260382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.285180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16853e76-d17a-4749-a100-f73ebf23c770 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.304960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:13.415560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.417126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.417853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.418857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.420046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.423902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.460773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1054/2088] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:13 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:13.465719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.487236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce46aab-e5e3-4ac5-91be-b557b2756635 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.495499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.497638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.498211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.498804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.500290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.502996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.535222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1035/2089] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:13.537781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.559526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94be2-7bd4-43d7-ba2f-8be2411049e5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.580982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.581778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.582789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.583220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.583602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] PATH_INFO: `/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5/users/9e7555d21eaf4f20a9d1c4530e2c17e3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.584938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:13.613768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6bf84b26704e0aa28de90e8d33fdc5, user_id=9e7555d21eaf4f20a9d1c4530e2c17e3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.617711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.643480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8703c-49ba-432b-a1f7-5ec73f1df13a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.663230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1055/2090] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:13 2022] PUT /identity/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5/users/9e7555d21eaf4f20a9d1c4530e2c17e3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:13.673176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.809663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.811471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.812051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.812920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] PATH_INFO: `/v3/users/ea93b15bebdb4bd2843719a9511f6101` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.815540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea93b15bebdb4bd2843719a9511f6101)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.819930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.853977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d70f-0938-41ea-b9df-0e82d9583ffd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.865261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.866073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.866354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.866631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.867407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.870153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:13.914179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1056/2091] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:13.916133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:13.946594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:13.971599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7aa5e-7c33-49d4-ab61-3b2603929396 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:13.981592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:13.982674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:13.983131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:13.983825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] PATH_INFO: `/v3/projects/1eaab2ca082f40fb81da3d40778b1850` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:13.985751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eaab2ca082f40fb81da3d40778b1850)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:13.989417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:14.027814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea93b15bebdb4bd2843719a9511f6101'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.065016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea93b15bebdb4bd2843719a9511f6101'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.079148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea93b15bebdb4bd2843719a9511f6101'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.080064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea93b15bebdb4bd2843719a9511f6101'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.081018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea93b15bebdb4bd2843719a9511f6101'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.107655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1036/2092] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:13 2022] DELETE /identity/v3/users/ea93b15bebdb4bd2843719a9511f6101 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:14.108909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.113047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.123504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eaab2ca082f40fb81da3d40778b1850', 'request_id': 'req-49430ffe-f949-444a-956e-2d1931545ced'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.141162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eaab2ca082f40fb81da3d40778b1850', 'request_id': 'req-49430ffe-f949-444a-956e-2d1931545ced'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.164996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eaab2ca082f40fb81da3d40778b1850', 'request_id': 'req-49430ffe-f949-444a-956e-2d1931545ced'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.179687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:14.186201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] The token cache is being invalidate because project 1eaab2ca082f40fb81da3d40778b1850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:14.187433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.191092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-49430ffe-f949-444a-956e-2d1931545ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:14.199869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1057/2093] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:13 2022] DELETE /identity/v3/projects/1eaab2ca082f40fb81da3d40778b1850 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:14.202933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edf10-2628-4e47-a3ea-52eb533dbf19 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.204161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edf10-2628-4e47-a3ea-52eb533dbf19 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.205874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5edf10-2628-4e47-a3ea-52eb533dbf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.216154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:14.244187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ea5edf10-2628-4e47-a3ea-52eb533dbf19 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.245768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2d79-c8df-4791-baa8-babbf812b4bb admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.247075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ea5edf10-2628-4e47-a3ea-52eb533dbf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.254298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.255450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.256030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.259758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] PATH_INFO: `/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5/users/9e7555d21eaf4f20a9d1c4530e2c17e3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.259758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6bf84b26704e0aa28de90e8d33fdc5, user_id=9e7555d21eaf4f20a9d1c4530e2c17e3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.269305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1058/2094] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.270274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:14.270508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3fc-681f-47eb-8d47-f58385135109 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.270508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3fc-681f-47eb-8d47-f58385135109 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.270508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dc3fc-681f-47eb-8d47-f58385135109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.283540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1037/2095] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:14 2022] PUT /identity/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5/users/9e7555d21eaf4f20a9d1c4530e2c17e3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:14.285897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.288181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.314816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f97dc3fc-681f-47eb-8d47-f58385135109 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.318674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f97dc3fc-681f-47eb-8d47-f58385135109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.412857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1059/2096] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.414506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.414795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.415069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.425099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487dbce-38c1-4179-92b3-fff935de914a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.429879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.430590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.430872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.431252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.447798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.449931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4356e-87e8-49d8-81b7-a8921a3d4ce1 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:14.469444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1038/2097] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:14.472363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.472892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.473328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.499300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] MFA Rules not processed for user `9e7555d21eaf4f20a9d1c4530e2c17e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.501802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.538549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:14.547393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.591745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1039/2098] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.599559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.616737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a16cb9-543d-49e8-9a12-6d66395af1df None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.623376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.624713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.625033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.625384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.626123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:14.626689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.628629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:14.661249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1040/2099] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:14.664103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.696147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc85fad-5e8e-46b4-b59c-5e5f86a62ce5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.708480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.716669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.717304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.717908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.719182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1060/2100] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:14.721144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.723477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:14.735885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.740039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:14.772631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1041/2101] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/projects => generated 359 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:14.779695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:14.874349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe79ec0-d223-482b-9958-9d003bb94035 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.929748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182aa80-352c-474b-8012-577f3d3ebbc1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:14.958677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:14.960328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:14.961648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:14.962174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:14.962911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:14.963818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:14.971355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.029823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.030855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.031629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.031629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.033719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1042/2102] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:14 2022] POST /identity/v3/users => generated 280 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:15.035021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:15.041459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:15.066838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d8227-71c6-4fd4-82bc-3cae946f1ce1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:15.073939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.075070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.075343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.075616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] PATH_INFO: `/v3/projects/217ff12738de449188bb46a6e80266a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.077157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=217ff12738de449188bb46a6e80266a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:15.079725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.135617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:15.135962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:15.138342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.157823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1061/2103] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:15.158475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:15.170034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217ff12738de449188bb46a6e80266a0', 'request_id': 'req-d8aa2411-4878-418b-99e8-51e019c4fcee'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:15.177354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1d41e-569a-457e-bd30-60909878ec68 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:15.185359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217ff12738de449188bb46a6e80266a0', 'request_id': 'req-d8aa2411-4878-418b-99e8-51e019c4fcee'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:15.197979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217ff12738de449188bb46a6e80266a0', 'request_id': 'req-d8aa2411-4878-418b-99e8-51e019c4fcee'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:15.229297 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] The token cache is being invalidate because project 217ff12738de449188bb46a6e80266a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:15.229820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:15.231634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:15.253017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1043/2104] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:15 2022] DELETE /identity/v3/projects/217ff12738de449188bb46a6e80266a0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:15.307798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.309605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.309965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.310218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.310965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:15.313522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.329001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1062/2105] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:15.333098 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:15.334759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:15.357017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2411-4878-418b-99e8-51e019c4fcee admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:15.363485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.364133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.364425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.364684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.365399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:15.367669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e304f-1630-469e-9317-78f3fcc48114 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.382371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1044/2106] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:15.387797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:15.416895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187dfe5-2949-4309-969b-be6371a5d418 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:15.436372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.438244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.439168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.440011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] PATH_INFO: `/v3/projects/a87fba72b12a458681c0cc3360903bae/users/49491943e40f4dbbb4be0ab89d195620/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.478487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a87fba72b12a458681c0cc3360903bae, user_id=49491943e40f4dbbb4be0ab89d195620, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:15.488183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:15.536864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1063/2107] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:15 2022] PUT /identity/v3/projects/a87fba72b12a458681c0cc3360903bae/users/49491943e40f4dbbb4be0ab89d195620/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:15.544963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.545483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.545483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:15.592225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] MFA Rules not processed for user `49491943e40f4dbbb4be0ab89d195620`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:15.595110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:15.810019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1045/2108] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:15.863802 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:15.865878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:15.990854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0612a-2559-4975-98f0-9c12e7e6ec61 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:15.997790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:15.998639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:15.998999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:15.999289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:16.011183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:16.013862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:16.019535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:16.034782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1064/2109] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:16.082413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:16.268455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104f7ac-3397-42fb-b579-95028388d0ac None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:16.278364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:16.280008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:16.280652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:16.281470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] PATH_INFO: `/v3/users/49491943e40f4dbbb4be0ab89d195620` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:16.284324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] RBAC: Authorizing `identity:delete_user(user_id=49491943e40f4dbbb4be0ab89d195620)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:16.288589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:16.380352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:16.383444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:16.412430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:16.447913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d60fe-0dd8-46ab-af62-90649648fbff service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:16.457449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49491943e40f4dbbb4be0ab89d195620'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.457681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:16.458705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:16.459288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:16.459793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] PATH_INFO: `/v3/users/a15ec544d3734490bd7165f3a84e7e55` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:16.462141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a15ec544d3734490bd7165f3a84e7e55)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:16.466626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:16.499216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49491943e40f4dbbb4be0ab89d195620'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.518723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49491943e40f4dbbb4be0ab89d195620'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.522011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49491943e40f4dbbb4be0ab89d195620'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.524543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a372306b-5da7-420e-94c0-3dddf01c474a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49491943e40f4dbbb4be0ab89d195620'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.560969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1046/2110] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:16 2022] DELETE /identity/v3/users/49491943e40f4dbbb4be0ab89d195620 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:16.563451 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:16.564118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:16.565245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:16.595816 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:16.597204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:16.659464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a15ec544d3734490bd7165f3a84e7e55'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.660798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a15ec544d3734490bd7165f3a84e7e55'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.678708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a15ec544d3734490bd7165f3a84e7e55'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.679934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a15ec544d3734490bd7165f3a84e7e55'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.702533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8fec6185-695f-4c08-a844-3fcdf5d7c964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a15ec544d3734490bd7165f3a84e7e55'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:16.739892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1047/2111] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:16.752635 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1065/2112] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:16 2022] DELETE /identity/v3/users/a15ec544d3734490bd7165f3a84e7e55 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:16.752971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:16.755453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:16.759915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:16.760389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:16.760950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:16.796486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:16.798552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:16.870742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82420394-2235-45ca-afcc-73b7cfa38abe None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:16.918672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1066/2113] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:16.927837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:16.930792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:16.978335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:16.979419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:16.979931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:16.981378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.002797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:17.005715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:17.028171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1048/2114] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:17.048220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a97c5-c045-4df3-85c1-98464ec14f7e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:17.054968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:17.056060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.056427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.057099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.070588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:17.072865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:17.088102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1067/2115] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:17.527984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:17.530438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:17.554326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71433f5f-3bc7-44c2-b4a0-6f28d650b45e service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:17.560943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:17.561779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.562072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.562409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] PATH_INFO: `/v3/projects/998dea45ca994174be483492001bd47a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.563780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998dea45ca994174be483492001bd47a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:17.566151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:17.609808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:17.698775 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998dea45ca994174be483492001bd47a', 'request_id': 'req-6a900dd4-8bbc-4814-ba1d-aac9ece30496'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:17.713696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998dea45ca994174be483492001bd47a', 'request_id': 'req-6a900dd4-8bbc-4814-ba1d-aac9ece30496'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:17.727588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998dea45ca994174be483492001bd47a', 'request_id': 'req-6a900dd4-8bbc-4814-ba1d-aac9ece30496'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:17.759516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] The token cache is being invalidate because project 998dea45ca994174be483492001bd47a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:17.760100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:17.763392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:17.770642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1049/2116] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:17 2022] DELETE /identity/v3/projects/998dea45ca994174be483492001bd47a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:17.771700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:17.784782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6d4ef-ff05-440e-810f-79844e3e1c0a service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:17.800126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:17.894400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:17.895174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:17.895628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:17.895769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] PATH_INFO: `/v3/users/9e7555d21eaf4f20a9d1c4530e2c17e3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:17.897774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7555d21eaf4f20a9d1c4530e2c17e3)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:17.899584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:17.968222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:17.975047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:17.995351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7555d21eaf4f20a9d1c4530e2c17e3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.000930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7555d21eaf4f20a9d1c4530e2c17e3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.024120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a900dd4-8bbc-4814-ba1d-aac9ece30496 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.033824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.035342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.036195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.036952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] PATH_INFO: `/v3/projects/a87fba72b12a458681c0cc3360903bae` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.054993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7555d21eaf4f20a9d1c4530e2c17e3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.057797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a87fba72b12a458681c0cc3360903bae)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.059082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7555d21eaf4f20a9d1c4530e2c17e3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.062820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.080009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-03e293cd-f66d-4405-b504-6c2ddd01ad4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7555d21eaf4f20a9d1c4530e2c17e3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.146034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1068/2117] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:17 2022] DELETE /identity/v3/users/9e7555d21eaf4f20a9d1c4530e2c17e3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:18.223808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a87fba72b12a458681c0cc3360903bae', 'request_id': 'req-959cf80d-9a40-46c8-ac9f-4474f10706a6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.242799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a87fba72b12a458681c0cc3360903bae', 'request_id': 'req-959cf80d-9a40-46c8-ac9f-4474f10706a6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.264762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a87fba72b12a458681c0cc3360903bae', 'request_id': 'req-959cf80d-9a40-46c8-ac9f-4474f10706a6'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.317818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] The token cache is being invalidate because project a87fba72b12a458681c0cc3360903bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:18.318130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.320078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-959cf80d-9a40-46c8-ac9f-4474f10706a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:18.322761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1050/2118] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:17 2022] DELETE /identity/v3/projects/a87fba72b12a458681c0cc3360903bae => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:18.330146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.330652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.331162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.374290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:18.376762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.526438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1069/2119] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:18.540411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.541153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.541637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.577067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:18.579545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.594204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1051/2120] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:18.598983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.611887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c0433-0346-4764-8b2a-64c5dfb7d37c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.619336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.620253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.620639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.625155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.625977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:18.626531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.628958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.656567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1070/2121] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:18.661597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.676469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e9e45-4618-47aa-acbf-59a46d78e722 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.687269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.688365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.689049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.689702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.690931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.694990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.755827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1052/2122] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:18 2022] POST /identity/v3/projects => generated 397 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:18.761084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.775207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0c7c-46e4-46e4-9e47-468557cd6017 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.803197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:18.868478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.872045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:18.886116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.888453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.888453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.889011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.890353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.895487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.935242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1071/2123] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:18 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:18.939941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.952953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641d30b-4d54-4192-a29f-d82a18658e2f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:18.958296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:18.958988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:18.960934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:18.960934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:18.960934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:18.962504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:18.983160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1072/2124] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:18.984659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:18.993214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:19.000120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabf460-40a9-4de1-a871-a046a761fffe admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.002596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0851e-87ad-446c-a3c5-97cc58889ab1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.006829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.008051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.008604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.008950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.009672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.011361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.017477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.018264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.018550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.018893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] PATH_INFO: `/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.020482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6bf84b26704e0aa28de90e8d33fdc5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.022688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.035352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1073/2125] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:19.048253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.094352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff903f-0807-4d31-96ee-2a74b3a39c8e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.108914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.110497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.111488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.112145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] PATH_INFO: `/v3/projects/10b2f2574bbe4035a57ba096d614182a/users/150018215af041afb7379cbf22b0b133/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.153547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b2f2574bbe4035a57ba096d614182a, user_id=150018215af041afb7379cbf22b0b133, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.157466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a1cf-657f-4733-bfc0-d2c511fc6bea admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.182640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6bf84b26704e0aa28de90e8d33fdc5', 'request_id': 'req-33bd5911-af61-4472-927c-d979077d12de'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:19.185370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1074/2126] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:19 2022] PUT /identity/v3/projects/10b2f2574bbe4035a57ba096d614182a/users/150018215af041afb7379cbf22b0b133/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:19.196585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6bf84b26704e0aa28de90e8d33fdc5', 'request_id': 'req-33bd5911-af61-4472-927c-d979077d12de'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:19.205016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b127c2-cb85-4ae9-b321-6554e2cf0ceb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.205326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b127c2-cb85-4ae9-b321-6554e2cf0ceb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.205651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b127c2-cb85-4ae9-b321-6554e2cf0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.213598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6bf84b26704e0aa28de90e8d33fdc5', 'request_id': 'req-33bd5911-af61-4472-927c-d979077d12de'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:19.252418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-97b127c2-cb85-4ae9-b321-6554e2cf0ceb None None] MFA Rules not processed for user `150018215af041afb7379cbf22b0b133`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:19.253835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-97b127c2-cb85-4ae9-b321-6554e2cf0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:19.263321 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] The token cache is being invalidate because project cd6bf84b26704e0aa28de90e8d33fdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:19.263795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:19.266814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33bd5911-af61-4472-927c-d979077d12de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:19.278784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1053/2127] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:18 2022] DELETE /identity/v3/projects/cd6bf84b26704e0aa28de90e8d33fdc5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:19.284725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.285145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.285461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.326038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:19.328889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:19.485188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1075/2128] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:19.498365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1054/2129] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:19.511066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.513531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.513782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:19.514852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.515678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.554352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:19.557433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:19.588094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1076/2130] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:19.596055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.618618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1343146-67b2-4474-8ef4-e958fc785ec7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.631678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638e420-b81d-4afc-81c9-8ea56e76922f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.634563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.635358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.635599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.635992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.642843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.644493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.645343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.646049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.647906 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:19.648985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.653108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.654670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.663771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.688463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1077/2131] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:19.694806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.695707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1055/2132] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:19.713930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2492f2-fa45-4139-b562-7b24b9d2fd20 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.722853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.724509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.725171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.725831 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.726824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.731185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.812469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1078/2133] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:19 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:19.817025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.838251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3518a67-979b-43bb-bc06-7e24f6c6ac06 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.914487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:20.006923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:20.010432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.011734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.012296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.014076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:20.017195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:20.079825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1056/2134] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:19 2022] POST /identity/v3/users => generated 285 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:20.084011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:20.106355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a93bf-8e5d-4f87-b545-69ce40e4e735 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:20.125498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:20.126527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.127000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.127479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.129476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:20.132637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:20.145320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:20.158492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1079/2135] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:20.165370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:20.192247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60c58b-b5cb-423a-b7f4-d86df68140bc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:20.203152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:20.204510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.205076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.205608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.206761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:20.210149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6a363-fee0-41f5-bf07-a6c4cb840cb8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:20.237636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1057/2136] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:20.242672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:20.265811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6792015-8afc-46f3-9579-1e1e65b8f1fc admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:20.283363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:20.284988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.285280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.285547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] PATH_INFO: `/v3/projects/b29b63361566420eb4e829ce64507a2a/users/c220fa33756a40b78e27d701b1a36aa6/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.350187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29b63361566420eb4e829ce64507a2a, user_id=c220fa33756a40b78e27d701b1a36aa6, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:20.361298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:20.418212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1080/2137] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:20 2022] PUT /identity/v3/projects/b29b63361566420eb4e829ce64507a2a/users/c220fa33756a40b78e27d701b1a36aa6/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:20.439127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:20.441491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:20.442201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:20.579548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] MFA Rules not processed for user `c220fa33756a40b78e27d701b1a36aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:20.582666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:20.816784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1058/2138] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:20.833117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:20.835984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:21.014190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1635a-08e2-4674-bb72-61d7dc5426a7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:21.018731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:21.019459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:21.019816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:21.020135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:21.033628 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:21.035491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948e55f-04f6-4605-b73b-5d6c0803228f service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:21.053048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1081/2139] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:22.392560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:22.546395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392da21-dc85-44be-a640-638f03bb5b46 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:22.555782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:22.556624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:22.557036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:22.557357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:22.560672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:22.659450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:22.712279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:22.720387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8050f99-05dc-4c3e-ac6e-74db0699ccd4 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:22.775454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1059/2140] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:23.313538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:23.314388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:23.314388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:23.316202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1082/2141] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:23.336731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:23.337054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:23.337460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:23.371038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] MFA Rules not processed for user `be96e2c5285540cca2ecc4e73a75cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:23.372294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:23.450429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:23.463917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:23.533223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1060/2142] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:25:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:23.548955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:23.558721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:23.577841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2d7f-4837-45e2-8dd9-20c718553eb5 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:23.585661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c4b89-4766-4ce3-921c-e2a979eb6cd4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:23.587297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:23.587952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:23.588339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:23.588615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] PATH_INFO: `/v3/users/581c56d3c7e84cb4abb342b449d5fc53` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:23.590983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] RBAC: Authorizing `identity:delete_user(user_id=581c56d3c7e84cb4abb342b449d5fc53)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:23.593055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:23.593257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:23.593975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:23.594247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:23.594396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:23.610096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:23.612889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:23.631475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1061/2143] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:23.676644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581c56d3c7e84cb4abb342b449d5fc53'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:23.677607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581c56d3c7e84cb4abb342b449d5fc53'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:23.700980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581c56d3c7e84cb4abb342b449d5fc53'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:23.700980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581c56d3c7e84cb4abb342b449d5fc53'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:23.710721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:23.715053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-461b6057-4c97-4280-a14c-5b9d4199713f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581c56d3c7e84cb4abb342b449d5fc53'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:23.758219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1083/2144] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:23 2022] DELETE /identity/v3/users/581c56d3c7e84cb4abb342b449d5fc53 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:24.113473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.141415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf7571-caf9-457b-9a35-6e9ca263a21f service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.259236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a2130-732d-41be-b924-daa40460927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.259872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2130-732d-41be-b924-daa40460927d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.260147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2130-732d-41be-b924-daa40460927d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.260424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a2130-732d-41be-b924-daa40460927d admin admin] PATH_INFO: `/v3/projects/2d45ac15901c44e58c0263df459c350f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.262254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a2130-732d-41be-b924-daa40460927d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d45ac15901c44e58c0263df459c350f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.264279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a2130-732d-41be-b924-daa40460927d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.329592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d45ac15901c44e58c0263df459c350f', 'request_id': 'req-445a2130-732d-41be-b924-daa40460927d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:24.336747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d45ac15901c44e58c0263df459c350f', 'request_id': 'req-445a2130-732d-41be-b924-daa40460927d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:24.343865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d45ac15901c44e58c0263df459c350f', 'request_id': 'req-445a2130-732d-41be-b924-daa40460927d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:24.354785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:24.361016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] The token cache is being invalidate because project 2d45ac15901c44e58c0263df459c350f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:24.361896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:24.362645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-445a2130-732d-41be-b924-daa40460927d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:24.364435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1062/2145] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:24 2022] DELETE /identity/v3/projects/2d45ac15901c44e58c0263df459c350f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:24.369958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.370548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.370548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.396456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:24.397827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:24.482504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1084/2146] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:24.498392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.498881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.499369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.526983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:24.528511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:24.537266 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1063/2147] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:24.543128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.555625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df574235-923f-483e-9875-13f0bf5c2cdf None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.562536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.563180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.563465 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.563743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.564426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:24.565190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.566863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.581879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1085/2148] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:25:24.586962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.597736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96584afa-6e6e-4ccc-8486-0c8a7bd8289f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.606403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.607444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.607921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.608448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.609724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.613609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.666000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1064/2149] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:24 2022] POST /identity/v3/projects => generated 387 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:24.672892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.686130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3182260-7ba6-4b5b-81f7-dd0751fc7a23 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.779016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.780086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.780550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.781090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.782425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.786182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.825262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1086/2150] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:24 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:24.829181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.843942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1389b6-193d-4ca0-a689-fed32399c05b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.849101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.849734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.850011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.850281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.850945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.852658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.865288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1065/2151] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:24.871653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.904874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e45abd-cdc3-48c8-b3f9-d03fb9ae994c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.913516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.914574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.915062 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.915541 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.916730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.919945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fe8e0-253e-4244-879f-9b714ddd414d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:24.945989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1087/2152] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:24.947761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:24.962506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f30e7b-42f2-441d-ae73-2e54445079be admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:24.970649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:24.971644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:24.972118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:24.972585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] PATH_INFO: `/v3/projects/e16216a1532a4493a058f74ce3dc9e5c/users/dc87a21f68cd48e5a7f19df075670e25/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:24.994345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16216a1532a4493a058f74ce3dc9e5c, user_id=dc87a21f68cd48e5a7f19df075670e25, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:24.997312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.014371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1066/2153] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:24 2022] PUT /identity/v3/projects/e16216a1532a4493a058f74ce3dc9e5c/users/dc87a21f68cd48e5a7f19df075670e25/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:25.025810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.026124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.026406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.068069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] MFA Rules not processed for user `dc87a21f68cd48e5a7f19df075670e25`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:25.069773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:25.140302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:25.201190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1088/2154] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:25.207052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.324645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e6742-8080-4eae-b164-1703ae3b50a5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.338569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.340964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.341924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.342681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.344182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.352169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.410171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1067/2155] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:25 2022] POST /identity/v3/projects => generated 387 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:25.413298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.429396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e2070-4f33-4003-b157-abe159c8a5fe None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.510300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.511178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.512147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.512551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.513376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.515522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.548988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1089/2156] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:25 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:25.552616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.567407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03eedf-8f11-4361-9946-45b8fe8b2933 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.576126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.577174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.577789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.578233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.579489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.582771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.606395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1068/2157] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:25.613494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.629746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659682-c5db-4a76-9785-4117a0233d38 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.638840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.639581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.639902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.640228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] PATH_INFO: `/v3/projects/1dfc107852b843e793513c8db3afd19e/users/9147047e7e584100848949ba1e6daee5/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.659657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfc107852b843e793513c8db3afd19e, user_id=9147047e7e584100848949ba1e6daee5, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.662913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.689246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1090/2158] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:25 2022] PUT /identity/v3/projects/1dfc107852b843e793513c8db3afd19e/users/9147047e7e584100848949ba1e6daee5/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:25.696292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.719796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b217f-773d-45f7-bc32-b22fca6ed173 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.803695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.804427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.804876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.805059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.805874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.807662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d43bc4-904e-4c67-9b8f-fa15fb1f2bab admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.828653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1069/2159] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:25.839351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:25.859211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9419b8-00e0-4abe-b070-40008d6f96cd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:25.868986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:25.870029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.870876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.872412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] PATH_INFO: `/v3/projects/1dfc107852b843e793513c8db3afd19e/users/9147047e7e584100848949ba1e6daee5/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.876324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dfc107852b843e793513c8db3afd19e, user_id=9147047e7e584100848949ba1e6daee5, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:25.880463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:25.906636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1091/2160] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:25 2022] PUT /identity/v3/projects/1dfc107852b843e793513c8db3afd19e/users/9147047e7e584100848949ba1e6daee5/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:25.926942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:25.927252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:25.927528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:25.949424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:25.970943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] MFA Rules not processed for user `9147047e7e584100848949ba1e6daee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:25.972320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.039054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:26.041605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.122309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1070/2161] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:26.141948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:26.144743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.155181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d78543-4401-449b-9fc9-fd8b2ec13bf2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:26.162955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:26.163980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.164524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.165121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] PATH_INFO: `/v3/users/150018215af041afb7379cbf22b0b133` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.167296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150018215af041afb7379cbf22b0b133)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:26.171987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:26.223679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:26.252883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e047dbd-16f9-4415-ac8d-37c8622aef53 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:26.260922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:26.262260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.262752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.263271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.263631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150018215af041afb7379cbf22b0b133'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.264596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150018215af041afb7379cbf22b0b133'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.280299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150018215af041afb7379cbf22b0b133'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.281116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150018215af041afb7379cbf22b0b133'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.282495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:26.284619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f89b1-1216-48d5-b78a-8e6b562eb1ed service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:26.295615 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150018215af041afb7379cbf22b0b133'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.299790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1071/2162] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:26.327527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1092/2163] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:26 2022] DELETE /identity/v3/users/150018215af041afb7379cbf22b0b133 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:26.334545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.335180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.335864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.377271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:26.378866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.445370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:26.448221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.567682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1072/2164] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:26.582863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:26.584787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.608186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd78d-3ab9-4263-b478-1e871d8defe9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:26.616061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:26.617501 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.617824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.618075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] PATH_INFO: `/v3/users/dc87a21f68cd48e5a7f19df075670e25` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.623035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc87a21f68cd48e5a7f19df075670e25)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:26.625177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:26.704851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:26.724721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc87a21f68cd48e5a7f19df075670e25'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.725437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc87a21f68cd48e5a7f19df075670e25'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.737340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbccc3-ccce-496a-a4fb-4d9d89c24929 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:26.746204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc87a21f68cd48e5a7f19df075670e25'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.747672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc87a21f68cd48e5a7f19df075670e25'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.764017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e3cae25e-87de-40fb-af88-7774c21e2c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc87a21f68cd48e5a7f19df075670e25'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:26.770315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:26.770965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.771245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.771519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.776255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.801393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1093/2165] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:26 2022] DELETE /identity/v3/users/dc87a21f68cd48e5a7f19df075670e25 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:26.806687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:26.806944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:26.807467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:26.843366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:26.847066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:26.851177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:26.855809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:26.876856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1073/2166] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:26.906193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:27.081530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1094/2167] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:27.093750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:27.095951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:27.138772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361fa4-d39c-4523-96f6-56ebad84b69e service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:27.269978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:27.270757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:27.271141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:27.271570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:27.285824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:27.288075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:27.300899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1074/2168] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:27.474695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:27.474695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:27.514261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21980f-a2a3-41ce-a414-4c006874c6e8 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:27.521901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:27.522771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:27.523188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:27.523637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] PATH_INFO: `/v3/projects/10b2f2574bbe4035a57ba096d614182a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:27.525582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b2f2574bbe4035a57ba096d614182a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:27.530653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:27.658199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b2f2574bbe4035a57ba096d614182a', 'request_id': 'req-c6c4652c-edb5-4617-b4fb-f4ca43df3647'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:27.681890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b2f2574bbe4035a57ba096d614182a', 'request_id': 'req-c6c4652c-edb5-4617-b4fb-f4ca43df3647'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:27.695530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b2f2574bbe4035a57ba096d614182a', 'request_id': 'req-c6c4652c-edb5-4617-b4fb-f4ca43df3647'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:27.722323 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] The token cache is being invalidate because project 10b2f2574bbe4035a57ba096d614182a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:27.722646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:27.723494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:27.729039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1095/2169] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:27 2022] DELETE /identity/v3/projects/10b2f2574bbe4035a57ba096d614182a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:27.856789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:27.865838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:27.922906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00b46d-5e5b-4315-b67b-817c3daf4c46 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:28.112420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:28.112420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:28.112420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:28.112420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] PATH_INFO: `/v3/projects/e16216a1532a4493a058f74ce3dc9e5c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.114641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16216a1532a4493a058f74ce3dc9e5c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:28.118876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:28.242385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16216a1532a4493a058f74ce3dc9e5c', 'request_id': 'req-17d8a8d6-d80d-4b59-947f-fec944266019'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.257174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16216a1532a4493a058f74ce3dc9e5c', 'request_id': 'req-17d8a8d6-d80d-4b59-947f-fec944266019'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.272222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16216a1532a4493a058f74ce3dc9e5c', 'request_id': 'req-17d8a8d6-d80d-4b59-947f-fec944266019'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.304233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] The token cache is being invalidate because project e16216a1532a4493a058f74ce3dc9e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:28.304911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.306168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.315023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1075/2170] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:27 2022] DELETE /identity/v3/projects/e16216a1532a4493a058f74ce3dc9e5c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:28.316772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:28.319306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:28.349412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4652c-edb5-4617-b4fb-f4ca43df3647 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:28.529968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:28.533009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:28.533336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:28.533855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] PATH_INFO: `/v3/users/9147047e7e584100848949ba1e6daee5` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.536371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9147047e7e584100848949ba1e6daee5)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:28.541149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:28.639287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9147047e7e584100848949ba1e6daee5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.640008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9147047e7e584100848949ba1e6daee5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.643612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:28.651267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9147047e7e584100848949ba1e6daee5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.652510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9147047e7e584100848949ba1e6daee5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.667182 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-90782edb-85b3-4fd7-b2fc-791f646b8a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9147047e7e584100848949ba1e6daee5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:28.700356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1096/2171] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:28 2022] DELETE /identity/v3/users/9147047e7e584100848949ba1e6daee5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:29.041561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.045052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:29.068539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8a8d6-d80d-4b59-947f-fec944266019 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.080784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:29.144102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.144760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.145079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.145356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] PATH_INFO: `/v3/projects/1dfc107852b843e793513c8db3afd19e` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.146778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dfc107852b843e793513c8db3afd19e)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.150320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.217827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dfc107852b843e793513c8db3afd19e', 'request_id': 'req-4a149583-f48d-4428-aab1-fcb7b4baeb4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:29.226652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dfc107852b843e793513c8db3afd19e', 'request_id': 'req-4a149583-f48d-4428-aab1-fcb7b4baeb4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:29.236035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dfc107852b843e793513c8db3afd19e', 'request_id': 'req-4a149583-f48d-4428-aab1-fcb7b4baeb4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:29.252778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] The token cache is being invalidate because project 1dfc107852b843e793513c8db3afd19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:29.253172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:29.253856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-4a149583-f48d-4428-aab1-fcb7b4baeb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:29.255445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1076/2172] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:29 2022] DELETE /identity/v3/projects/1dfc107852b843e793513c8db3afd19e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:29.261511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.261923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.262562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.294656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:29.295938 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:29.371025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1097/2173] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:29.379116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83586-a405-4160-9141-6844e60b271e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.379394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83586-a405-4160-9141-6844e60b271e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.379665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc83586-a405-4160-9141-6844e60b271e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.406013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-1bc83586-a405-4160-9141-6844e60b271e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:29.407797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1bc83586-a405-4160-9141-6844e60b271e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:29.426406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1077/2174] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:29.428698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.447638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293bd4f-07c2-4eeb-8f5a-272bbbf2ff78 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.460536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.461655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.462163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.462664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.464850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:29.465413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.469279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.493288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1098/2175] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:29.498928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83586-a405-4160-9141-6844e60b271e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.509837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc83586-a405-4160-9141-6844e60b271e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.516570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.517864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.518597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.519044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.520575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.523290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.571478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1078/2176] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:29.572983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.588766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af5656-bb2b-4004-947a-f6411e6d36a2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.691331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.692295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.692625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.693002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.694136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.696336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.737965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1099/2177] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:29.744624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.767375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ca9f6-c984-4742-af68-6e2810aa5738 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.774037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.775043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.775475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.775915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.777403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.779362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.796209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1079/2178] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:29.798282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.819678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9892a-3a7f-4ac4-801d-e73271a61e2b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.828636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.830225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.830618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.831177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.832523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.845292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0cc23-7d02-4312-8317-0a079c999ae1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.848011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1100/2179] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:29.853914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:29.873871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024e05f-8206-49c0-9ee4-8d5e2bedd678 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:29.879778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:29.880629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.881110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.881489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] PATH_INFO: `/v3/projects/71f01a60810d48e781e0d812d0b471fb/users/ec9c06d949504a9ca2bedcc819473bc6/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.901313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f01a60810d48e781e0d812d0b471fb, user_id=ec9c06d949504a9ca2bedcc819473bc6, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:29.904703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:29.935694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1080/2180] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:29 2022] PUT /identity/v3/projects/71f01a60810d48e781e0d812d0b471fb/users/ec9c06d949504a9ca2bedcc819473bc6/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:29.951000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:29.951298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:29.951554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:29.988167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] MFA Rules not processed for user `ec9c06d949504a9ca2bedcc819473bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:29.989697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:30.020274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:30.087701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1101/2181] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:30.093738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.149340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:30.187175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be828fc9-e63b-4c1f-8ae8-1d11a1f49444 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.193100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.193865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.194256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.194621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.195360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.197854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.233703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1081/2182] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:30 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:30.238671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.253101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be4fb7-fccc-4757-840e-ee7190ed32ab None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.342709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.343357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.343654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.344040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.344862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.349486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.378723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1102/2183] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:30 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:30.384627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.415938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e26e-1a75-4e09-b612-3d9ef94dad50 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.426216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.426971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.427261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.427528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.428854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.429897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.444854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1082/2184] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:30.450211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.471076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c2faf-c8d6-4718-be83-dbb0d30b8ae6 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.480399 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.481759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.482338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.482928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] PATH_INFO: `/v3/projects/2f39260eaee24bae8983595dfb9c8b75/users/039448a396ae49949845373333e7bc88/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.514285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f39260eaee24bae8983595dfb9c8b75, user_id=039448a396ae49949845373333e7bc88, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.518641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.543211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1103/2185] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:30 2022] PUT /identity/v3/projects/2f39260eaee24bae8983595dfb9c8b75/users/039448a396ae49949845373333e7bc88/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:30.548143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.562171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e2672-abfe-4afc-9831-8bfddff249ca admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.657003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.658138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.658880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.659048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.660211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.663720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bbee7-c1b7-4864-8a3a-44f4233f0222 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.685494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1083/2186] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:30.690124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.703653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160fab5-d338-4124-a96b-54b01086a545 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:30.709174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:30.709952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.710873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.710873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] PATH_INFO: `/v3/projects/2f39260eaee24bae8983595dfb9c8b75/users/039448a396ae49949845373333e7bc88/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.712668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f39260eaee24bae8983595dfb9c8b75, user_id=039448a396ae49949845373333e7bc88, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:30.715918 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:30.730735 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1104/2187] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:30 2022] PUT /identity/v3/projects/2f39260eaee24bae8983595dfb9c8b75/users/039448a396ae49949845373333e7bc88/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:30.743022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:30.743311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:30.743592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:30.788726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] MFA Rules not processed for user `039448a396ae49949845373333e7bc88`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:30.791855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:30.937406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1084/2188] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:30.959780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:30.961979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:31.063381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c5b9-d8a6-4d0d-8bc9-a57fa21d04f8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:31.071842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:31.073219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:31.073798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:31.074942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:31.139222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:31.186517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:31.188401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:31.201293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1105/2189] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:36.243782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:36.245317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:36.260408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78c04f-3fa2-4c69-96e1-5a21f96145a7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:36.265973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:36.266606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:36.267015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:36.267164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:36.278721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:36.280234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41103f-af29-45ef-889c-cf35e2699309 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:36.295366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1085/2190] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:41.194852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=14 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:42.876195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:42.965162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1343b8-82b3-43d4-9542-591ab151d49e service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:42.970038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:42.970695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:42.970969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:42.971241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] PATH_INFO: `/v3/users/ec9c06d949504a9ca2bedcc819473bc6` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:42.972480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9c06d949504a9ca2bedcc819473bc6)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:42.974521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:43.035211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9c06d949504a9ca2bedcc819473bc6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.035928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9c06d949504a9ca2bedcc819473bc6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.048160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9c06d949504a9ca2bedcc819473bc6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.048883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9c06d949504a9ca2bedcc819473bc6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.063602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9c06d949504a9ca2bedcc819473bc6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.090574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1106/2191] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:42 2022] DELETE /identity/v3/users/ec9c06d949504a9ca2bedcc819473bc6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:43.096255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:43.097012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:43.097012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:43.125346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:43.126121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:43.144033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:43.203344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1086/2192] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:43.213928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:43.216001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:43.293546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a865218-b47b-48ab-92a9-0477f501e251 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:43.297567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:43.298234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:43.298512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:43.298791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:43.312758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:43.314799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:43.327684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1107/2193] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:43.772309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:43.773788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:43.787656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c11600-75ba-4a16-8ed7-51511a624512 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:43.794232 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:43.794951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:43.795229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:43.795501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] PATH_INFO: `/v3/projects/71f01a60810d48e781e0d812d0b471fb` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:43.797078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f01a60810d48e781e0d812d0b471fb)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:43.800141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:43.914980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f01a60810d48e781e0d812d0b471fb', 'request_id': 'req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.923269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f01a60810d48e781e0d812d0b471fb', 'request_id': 'req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.931359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f01a60810d48e781e0d812d0b471fb', 'request_id': 'req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.954693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] The token cache is being invalidate because project 71f01a60810d48e781e0d812d0b471fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:43.955250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.956484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:43.959123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1087/2194] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:43 2022] DELETE /identity/v3/projects/71f01a60810d48e781e0d812d0b471fb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:43.965268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:43.983445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0703a-3967-4c37-ad96-5c90bbcccc67 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:44.013820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:44.091474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:44.092747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:44.093031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:44.095195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] PATH_INFO: `/v3/users/039448a396ae49949845373333e7bc88` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:44.095463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] RBAC: Authorizing `identity:delete_user(user_id=039448a396ae49949845373333e7bc88)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:44.098168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:44.208038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039448a396ae49949845373333e7bc88'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:44.209201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039448a396ae49949845373333e7bc88'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:44.225116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039448a396ae49949845373333e7bc88'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:44.225951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039448a396ae49949845373333e7bc88'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:44.238559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-081e6eac-e985-4573-8082-2dc7c621395f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039448a396ae49949845373333e7bc88'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:44.269249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1108/2195] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:43 2022] DELETE /identity/v3/users/039448a396ae49949845373333e7bc88 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:44.746749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:44.750341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:44.779038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf395b-b8ce-4e6e-ac34-c927d1c42c18 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:44.869340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:44.871235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:44.872345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:44.872661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] PATH_INFO: `/v3/projects/2f39260eaee24bae8983595dfb9c8b75` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:44.874173 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f39260eaee24bae8983595dfb9c8b75)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:44.876292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:44.983782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:44.989886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f39260eaee24bae8983595dfb9c8b75', 'request_id': 'req-8090969b-917a-4411-bdcf-c71319dbd1d9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:45.009438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f39260eaee24bae8983595dfb9c8b75', 'request_id': 'req-8090969b-917a-4411-bdcf-c71319dbd1d9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:45.021299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f39260eaee24bae8983595dfb9c8b75', 'request_id': 'req-8090969b-917a-4411-bdcf-c71319dbd1d9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:45.048498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] The token cache is being invalidate because project 2f39260eaee24bae8983595dfb9c8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:45.049050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:45.050228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8090969b-917a-4411-bdcf-c71319dbd1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:45.061836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1088/2196] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:44 2022] DELETE /identity/v3/projects/2f39260eaee24bae8983595dfb9c8b75 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:45.064578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.065586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.065586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.093067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:45.094509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:45.193701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1109/2197] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:45.204536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.204865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.205141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.230750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:45.232870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:45.247586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1089/2198] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:45.254394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.275302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b2836-fb43-4824-ab4f-feaf600fbaaf None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.284958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.285958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.286413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.286872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.287865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:45.288378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.291372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.318015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1110/2199] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:25:45.323072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.336750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6798156-51ee-4c88-b02e-e81fbed14318 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.344953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.345952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.346284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.346651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.347542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.350564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.388143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1090/2200] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:45 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:45.393962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.409589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e88d8d-a82a-4e43-ae77-f8bf08a9773d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.448195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:45.499447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.500126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.500494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.500913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.501670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.504327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.534622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1111/2201] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:45 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:45.539499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.552091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45772d-60ab-4878-b732-be71c60453bf admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.558388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.559259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.559618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.559957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.560736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.562596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.584103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1091/2202] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:45.589764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.607133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e08b5-b26d-4475-b41b-efd20d245f38 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.612462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.613133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.613416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.613694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.614372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.616202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236b63c-a5e2-4a15-a308-4abd50e42a42 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.631376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1112/2203] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:45.639764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.659573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ae0e-3d44-49de-a88f-b5baee39fbbb admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:45.668080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:45.669290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.669779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.670317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] PATH_INFO: `/v3/projects/ab767994a50e4bb698d8bb13d314a8c9/users/a31152f8fb454bdc888650f3a7bdbcd1/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.702445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab767994a50e4bb698d8bb13d314a8c9, user_id=a31152f8fb454bdc888650f3a7bdbcd1, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:45.708053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:45.736153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1092/2204] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:45 2022] PUT /identity/v3/projects/ab767994a50e4bb698d8bb13d314a8c9/users/a31152f8fb454bdc888650f3a7bdbcd1/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:45.755940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:45.756233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:45.756390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:45.799937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] MFA Rules not processed for user `a31152f8fb454bdc888650f3a7bdbcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:45.801383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:45.909607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1113/2205] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:45.926036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:45.929189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:46.038457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a35e0-3732-474b-acc6-5e82e5f254fa admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:46.043906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:46.044624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:46.045085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:46.045390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:46.058390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:46.062030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:46.078615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1093/2206] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:49.467554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:49.469801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:49.558715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab6dd0-cbc2-4d8a-a877-8e2adf2934ea None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:49.563313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:49.563930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:49.564213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:49.564487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] PATH_INFO: `/v3/users/370f6caf87624069946c07352b29163d` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:49.565733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=370f6caf87624069946c07352b29163d)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:49.567700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:49.618285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:49.626988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370f6caf87624069946c07352b29163d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:49.636447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370f6caf87624069946c07352b29163d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:49.650951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370f6caf87624069946c07352b29163d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:49.653355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370f6caf87624069946c07352b29163d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:49.669261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370f6caf87624069946c07352b29163d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:49.696800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1114/2207] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:49 2022] DELETE /identity/v3/users/370f6caf87624069946c07352b29163d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:50.017159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.029487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5473e2-333f-43e5-a22c-898492893312 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.091948 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.094391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.133432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.134701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.135134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.135723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] PATH_INFO: `/v3/projects/6abf0c1ad2664fa796d6a025b584a9a8` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.137760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abf0c1ad2664fa796d6a025b584a9a8)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.140040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.171095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:50.198837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe43fa-20fa-4792-8333-d203b073e90e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.204722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.205502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.205777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.206043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] PATH_INFO: `/v3/users/a31152f8fb454bdc888650f3a7bdbcd1` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.207282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31152f8fb454bdc888650f3a7bdbcd1)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.209462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.228447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abf0c1ad2664fa796d6a025b584a9a8', 'request_id': 'req-c968ce37-08c5-4f41-b8a9-3d777930e5cc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.238169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abf0c1ad2664fa796d6a025b584a9a8', 'request_id': 'req-c968ce37-08c5-4f41-b8a9-3d777930e5cc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.244926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abf0c1ad2664fa796d6a025b584a9a8', 'request_id': 'req-c968ce37-08c5-4f41-b8a9-3d777930e5cc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.264719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] The token cache is being invalidate because project 6abf0c1ad2664fa796d6a025b584a9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:50.265235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.266268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.269452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1094/2208] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:50 2022] DELETE /identity/v3/projects/6abf0c1ad2664fa796d6a025b584a9a8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:50.273384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.275065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.288348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31152f8fb454bdc888650f3a7bdbcd1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.289206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31152f8fb454bdc888650f3a7bdbcd1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.299521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31152f8fb454bdc888650f3a7bdbcd1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.300276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31152f8fb454bdc888650f3a7bdbcd1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.313646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-643d260d-435e-439c-92c3-cf0e86c21661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31152f8fb454bdc888650f3a7bdbcd1'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.352337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1115/2209] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:50 2022] DELETE /identity/v3/users/a31152f8fb454bdc888650f3a7bdbcd1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:50.359946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.360449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.361241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.402051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:50.404739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.412240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968ce37-08c5-4f41-b8a9-3d777930e5cc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.465970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:50.522863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.523819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.524216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.524721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] PATH_INFO: `/v3/users/f0ab675d4cc54507b3d86e30aa5becc2` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.527294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ab675d4cc54507b3d86e30aa5becc2)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.530083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.531909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1116/2210] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:50.551287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:50.553716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:50.628083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ab675d4cc54507b3d86e30aa5becc2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.638805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:50.646094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ab675d4cc54507b3d86e30aa5becc2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.649870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f161d-6752-4e87-ade5-f0627376e56c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:50.655001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:50.655926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:50.656537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:50.656982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:50.659748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ab675d4cc54507b3d86e30aa5becc2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.660642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ab675d4cc54507b3d86e30aa5becc2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.661409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ab675d4cc54507b3d86e30aa5becc2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:50.670121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:50.672409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:50.682994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1095/2211] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:50 2022] DELETE /identity/v3/users/f0ab675d4cc54507b3d86e30aa5becc2 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:50.690508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1117/2212] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:51.013207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.015036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.128671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d6d44-3bb3-4ccb-a389-7f4dba668766 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.135005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.136091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.136367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.136685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] PATH_INFO: `/v3/projects/2154cfc86ef74e84accb94fd2cc8d933` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.138029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2154cfc86ef74e84accb94fd2cc8d933)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.140156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.146580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.149249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.197898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c94d54-b04a-4408-82e6-181e20b55815 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.221180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2154cfc86ef74e84accb94fd2cc8d933', 'request_id': 'req-795f3e55-2cb7-4930-8ca7-599590f38105'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.232541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2154cfc86ef74e84accb94fd2cc8d933', 'request_id': 'req-795f3e55-2cb7-4930-8ca7-599590f38105'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.241611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2154cfc86ef74e84accb94fd2cc8d933', 'request_id': 'req-795f3e55-2cb7-4930-8ca7-599590f38105'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.260945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] The token cache is being invalidate because project 2154cfc86ef74e84accb94fd2cc8d933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:51.261246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.261935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-795f3e55-2cb7-4930-8ca7-599590f38105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.263459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1096/2213] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:51 2022] DELETE /identity/v3/projects/2154cfc86ef74e84accb94fd2cc8d933 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:51.268284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaee66-d9df-496b-bb0c-72e6c5dd9cee None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.268579 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaee66-d9df-496b-bb0c-72e6c5dd9cee None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.268957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaee66-d9df-496b-bb0c-72e6c5dd9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.274788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.275515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.275792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.276085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] PATH_INFO: `/v3/projects/ab767994a50e4bb698d8bb13d314a8c9` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.278335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab767994a50e4bb698d8bb13d314a8c9)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.280397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.291023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-99aaee66-d9df-496b-bb0c-72e6c5dd9cee None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:51.292729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-99aaee66-d9df-496b-bb0c-72e6c5dd9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.301439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1097/2214] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:51.310675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.311156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.311615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.340506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:51.340506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.350303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab767994a50e4bb698d8bb13d314a8c9', 'request_id': 'req-61b78800-a44a-4a7b-a18d-7bc72535ce41'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.361207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab767994a50e4bb698d8bb13d314a8c9', 'request_id': 'req-61b78800-a44a-4a7b-a18d-7bc72535ce41'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.368553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab767994a50e4bb698d8bb13d314a8c9', 'request_id': 'req-61b78800-a44a-4a7b-a18d-7bc72535ce41'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.380994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] The token cache is being invalidate because project ab767994a50e4bb698d8bb13d314a8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:51.381416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.382052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-61b78800-a44a-4a7b-a18d-7bc72535ce41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:51.383821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1118/2215] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:51 2022] DELETE /identity/v3/projects/ab767994a50e4bb698d8bb13d314a8c9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:51.390334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a3c0-c807-4b64-a541-793484ea483c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.390726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a3c0-c807-4b64-a541-793484ea483c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.391203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a3c0-c807-4b64-a541-793484ea483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.403907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:51.422648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1098/2216] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:51.427126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.432141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0424a3c0-c807-4b64-a541-793484ea483c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:51.433694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0424a3c0-c807-4b64-a541-793484ea483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.440881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20957de6-f8f1-4560-84e5-65e09c0239ad None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.447105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.449608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.449914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.450186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.450973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:51.451278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.453291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.453422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1119/2217] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:51.462763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.463045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.463327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.473559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1099/2218] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:25:51.473793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:51.475022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.488440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593180b-aaa1-4231-84a5-486482cd961e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.491551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:51.492796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.494821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.496111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.496531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.496977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.497984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.500033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.502687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1120/2219] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:51.507318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.527014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f952d6-5c79-4bdd-a3cd-fa1166917a9b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.532296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1100/2220] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:51.533425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.534157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.534437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.534703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.535649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:51.535858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.537578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.538000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.556942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1121/2221] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:51.558981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.570141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97285418-5bd0-406d-8454-8381ef838ce5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.610222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e64c4-1e91-4f05-a104-3abd1b6e038c admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.615151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.615786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.616067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.616346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.617016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.618981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.647948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1101/2222] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:51.654382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.666603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c644ab9-7304-4e46-96ae-4efcdd1dc1e9 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.668477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.669407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.669691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.669962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.670675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.673093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.675264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.676428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.676428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.676726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.677474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.679407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.693258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1102/2223] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:51.698484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.716060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5598e4f-0890-44c5-9b46-6997d13bd750 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.721751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.722430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.722756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.723029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.723684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.725304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1122/2224] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:51.725435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.730454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.741746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1103/2225] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:51.745111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.764275 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ac682-206c-4d03-9e53-d77245902436 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.819159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d291734-d9ce-47b4-92d6-5ce80e1cabbb admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.824403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.825191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.825482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.825760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.826458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.828389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.856236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.856971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.857318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.857530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] PATH_INFO: `/v3/projects/3a5f672a5c7d4b0aa7fee5a2bb77303a/users/2ecc38ef799343eabb84a1a1a066163a/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.867460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1123/2226] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:51.868616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.873447 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5f672a5c7d4b0aa7fee5a2bb77303a, user_id=2ecc38ef799343eabb84a1a1a066163a, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.877652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.884954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca78f-c109-42ba-805f-aaf5dac5e9a1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.884954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.885447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.886024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.886375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.887209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:51.888866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9372a-ef9e-46a3-9728-45b4dc14cd8d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:51.896333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1104/2227] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:51 2022] PUT /identity/v3/projects/3a5f672a5c7d4b0aa7fee5a2bb77303a/users/2ecc38ef799343eabb84a1a1a066163a/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:51.900567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1124/2228] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:51.905821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:51.907604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.907604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.909884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.918440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:51.939922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] MFA Rules not processed for user `2ecc38ef799343eabb84a1a1a066163a`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:51.941223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:51.987394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee6a9d-2916-4679-b9a2-28cb0f02b966 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:51.993264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:51.996430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:51.997105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:51.997382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:51.997653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:51.998346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.001606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.014938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1105/2229] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:52.019100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:52.032000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c6a06-d672-4873-b2d6-8f59e2794f7d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:52.038533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:52.039650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.040021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.040507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] PATH_INFO: `/v3/projects/fdd2c8f4cef04570b3ed5da4039f9ed2/users/118411d6e1674531a381bb0aa9960b99/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.041297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1125/2230] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:52.054954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:52.056765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:52.071559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd2c8f4cef04570b3ed5da4039f9ed2, user_id=118411d6e1674531a381bb0aa9960b99, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.077863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b714977-7067-4072-89b0-d4709ae12d2f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.111907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1106/2231] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:52 2022] PUT /identity/v3/projects/fdd2c8f4cef04570b3ed5da4039f9ed2/users/118411d6e1674531a381bb0aa9960b99/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:52.115455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.116062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.116624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.134915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8aa8e-a3a4-4b4b-af97-8fc83bcadb84 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:52.162363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] MFA Rules not processed for user `118411d6e1674531a381bb0aa9960b99`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:52.163972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:52.232106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:52.232775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.233264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.233740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.250244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1107/2232] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:52.267188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:52.270072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:52.336064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.337682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.350750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1126/2233] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:52.379093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:52.382028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60901bbf-5a6c-4b28-b836-bfcb973a9ed6 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:52.389567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:52.390452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.391568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.391568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.412528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.414112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71221a-3307-40c9-9ee5-46c5fc1b785e service glance] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.430436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1108/2234] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:52.449305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:52.474172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad900e76-23e7-46d8-a8e2-efa22f0d3cdc service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:52.480621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:52.481776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.482285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.482706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] PATH_INFO: `/v3/users/2ecc38ef799343eabb84a1a1a066163a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.487559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecc38ef799343eabb84a1a1a066163a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.489839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.551960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecc38ef799343eabb84a1a1a066163a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:52.552874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecc38ef799343eabb84a1a1a066163a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:52.562570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecc38ef799343eabb84a1a1a066163a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:52.563392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecc38ef799343eabb84a1a1a066163a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:52.572409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecc38ef799343eabb84a1a1a066163a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:52.599403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1127/2235] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:52 2022] DELETE /identity/v3/users/2ecc38ef799343eabb84a1a1a066163a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:25:52.606817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.607280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.607736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.639109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:52.640368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:52.651679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:52.734152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1109/2236] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:52.744772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:52.747449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:52.826371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce23ac5-0057-4bcd-aef4-d2400ed4efc8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:52.832127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:52.832691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:52.833008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:52.833358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:52.843659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:52.845188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8c953-00a4-4ee4-8985-a0f260afaaad service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:52.860783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1128/2237] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:53.275633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:53.280046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:53.317047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbc57a-1f15-41ab-af4e-da2602175a7c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:53.328490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:53.329311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.330007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.330292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] PATH_INFO: `/v3/projects/3a5f672a5c7d4b0aa7fee5a2bb77303a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.331975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5f672a5c7d4b0aa7fee5a2bb77303a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:53.334341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:53.423392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5f672a5c7d4b0aa7fee5a2bb77303a', 'request_id': 'req-9371f3f6-9c42-4518-afc0-fc34be2efe65'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:53.432227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5f672a5c7d4b0aa7fee5a2bb77303a', 'request_id': 'req-9371f3f6-9c42-4518-afc0-fc34be2efe65'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:53.440523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5f672a5c7d4b0aa7fee5a2bb77303a', 'request_id': 'req-9371f3f6-9c42-4518-afc0-fc34be2efe65'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:53.459185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] The token cache is being invalidate because project 3a5f672a5c7d4b0aa7fee5a2bb77303a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:53.459547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:53.460573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9371f3f6-9c42-4518-afc0-fc34be2efe65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:53.462594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1110/2238] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:53 2022] DELETE /identity/v3/projects/3a5f672a5c7d4b0aa7fee5a2bb77303a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:53.471882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.472602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.473187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.514405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:53.515665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:53.603514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1129/2239] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:53.614002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.614493 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.614849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.660402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:53.661675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:53.674010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1111/2240] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:53.680974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:53.699394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd250f-640d-43d8-9b3c-b2d0f0a79015 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:53.708767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:53.709898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.710363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.710921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.712256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:53.712788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:53.716393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:53.722057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:53.744588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1130/2241] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:25:53.746367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:53.762216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852adb1-80c8-4ff7-a381-239a34209df6 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:53.770271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:53.771208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.771489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.771753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.772428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:53.774509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:53.811391 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1112/2242] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:53 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:53.822798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:53.837448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57939-0eab-49cd-b641-221012e5f6ba admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:53.925473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:53.926108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.926397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.926670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.928757 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:53.929564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:53.971647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1131/2243] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:53 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:53.973442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:53.986978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac55a13-f8cc-46dc-b9c4-ac010cd21d9e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:53.994001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:53.994001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:53.994001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:53.994001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:53.994668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:53.997117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:54.015090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1113/2244] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:54.019332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:54.034032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274bee7-fd87-42b4-8f17-b1d41f6b4f23 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:54.039289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:54.039922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:54.040201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:54.040475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:54.041178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:54.043724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a4a4a-67f2-4806-96a2-7cdbdff64114 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:54.057225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1132/2245] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:54.062456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:54.074727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3678179-7146-4a7f-ba8e-0cda8e8f6eb7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:54.080936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:54.080936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:54.081298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:54.081591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] PATH_INFO: `/v3/projects/d55cf445cc814c2e81d385c6484c3dd6/users/925e09732db84c1e85d29245f95a9194/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:54.112598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55cf445cc814c2e81d385c6484c3dd6, user_id=925e09732db84c1e85d29245f95a9194, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:54.115563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:54.144453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1114/2246] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:54 2022] PUT /identity/v3/projects/d55cf445cc814c2e81d385c6484c3dd6/users/925e09732db84c1e85d29245f95a9194/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:54.159617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:54.159905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:54.160187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:54.199650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] MFA Rules not processed for user `925e09732db84c1e85d29245f95a9194`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:54.201164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:54.292580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1133/2247] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:54.313410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:54.315686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:54.359182 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:54.389456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861c88-bc5c-4d09-a8c0-3eb0e6a57fd3 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:54.394215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:54.394853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:54.395133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:54.395401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:54.406243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:54.407806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283f57-aec6-4822-bf20-3559e2c717b0 service glance] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:54.418057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1115/2248] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:56.958629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:56.960408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:57.058859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f64896-6396-444a-87c0-33636bbbf785 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:57.064086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:57.066004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:57.066657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:57.067144 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] PATH_INFO: `/v3/users/c220fa33756a40b78e27d701b1a36aa6` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:57.069642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c220fa33756a40b78e27d701b1a36aa6)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:57.074051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:57.081952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:57.160217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c220fa33756a40b78e27d701b1a36aa6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.161088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c220fa33756a40b78e27d701b1a36aa6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.170755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c220fa33756a40b78e27d701b1a36aa6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.171496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c220fa33756a40b78e27d701b1a36aa6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.185077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c220fa33756a40b78e27d701b1a36aa6'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.221945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1134/2249] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:56 2022] DELETE /identity/v3/users/c220fa33756a40b78e27d701b1a36aa6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:57.227981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:57.228720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:57.228720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:57.259351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:57.262235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:57.389401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1116/2250] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:25:57.400573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:57.403029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:57.488173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e0eaf-755b-4a37-80c2-71c7355f1c5c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:57.492179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:57.492898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:57.493199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:57.493728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:57.509229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:57.512177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023ac83-16d0-4327-b30c-582284f49ee6 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:57.523712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1135/2251] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:57.874438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:57.876287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:57.895781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3829-82c6-46d6-b1e3-38f08e5fca76 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:57.901768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:57.902533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:57.902807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:57.903290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] PATH_INFO: `/v3/projects/b29b63361566420eb4e829ce64507a2a` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:57.904644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29b63361566420eb4e829ce64507a2a)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:57.906642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:57.962376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29b63361566420eb4e829ce64507a2a', 'request_id': 'req-0372ed52-8601-4e0e-a797-171cfaf03b64'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.970071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29b63361566420eb4e829ce64507a2a', 'request_id': 'req-0372ed52-8601-4e0e-a797-171cfaf03b64'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.976299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29b63361566420eb4e829ce64507a2a', 'request_id': 'req-0372ed52-8601-4e0e-a797-171cfaf03b64'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.994638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] The token cache is being invalidate because project b29b63361566420eb4e829ce64507a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:57.995522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.996334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-0372ed52-8601-4e0e-a797-171cfaf03b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:57.998549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1117/2252] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:57 2022] DELETE /identity/v3/projects/b29b63361566420eb4e829ce64507a2a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:58.004110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.005080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.005080 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.031038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:58.032356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:58.139084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1136/2253] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:58.147300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.147574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.147849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.171225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:58.172923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:58.181907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1118/2254] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:58.189502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.203817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7732a-ff17-407a-9021-14dfa801600d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.209205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.209870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.210160 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.210438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.211117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:25:58.211431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.213184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.228680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1137/2255] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:25:58.234380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.244358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3724b1-4ef5-44d2-80a6-6294cec13a1b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.249904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.250534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.250811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.251078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.251733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.253721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.300165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1119/2256] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:25:58.301934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.321526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39bb53-ae88-49fd-a476-d61e35784c9f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.339406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:58.484417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.485519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.486039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.486624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.487439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.490523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.518333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1138/2257] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:25:58.522668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.535476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384808ad-0765-4ab0-bcfd-ee592c54bc1e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.540699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.541370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.543008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.543008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.543333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.544731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.556122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1120/2258] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:25:58.562409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.579940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197e3f-e658-4ce8-84db-d02af85de1f9 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.590968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.592173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.592674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.593207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.594408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.597773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a11cb-6cbb-4dae-b896-0946a211c737 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.622113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1139/2259] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:25:58.626908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.645949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a620-efcb-485f-a29c-ee1533021a91 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.654065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.655211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.655677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.656153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] PATH_INFO: `/v3/projects/6f531eb9f8294ec2a7176d09a525a143/users/d50395a72f664c84bc289ae04a71a5b5/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.686202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f531eb9f8294ec2a7176d09a525a143, user_id=d50395a72f664c84bc289ae04a71a5b5, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:58.691684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:58.697550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:58.715227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1121/2260] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:25:58 2022] PUT /identity/v3/projects/6f531eb9f8294ec2a7176d09a525a143/users/d50395a72f664c84bc289ae04a71a5b5/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:58.720848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc2b4-05d7-4a45-9e82-c207ee22edd2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.721369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc2b4-05d7-4a45-9e82-c207ee22edd2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.721688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcc2b4-05d7-4a45-9e82-c207ee22edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:58.749774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a8bcc2b4-05d7-4a45-9e82-c207ee22edd2 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:58.751219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a8bcc2b4-05d7-4a45-9e82-c207ee22edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:58.845925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1140/2261] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:58.860083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:58.863815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:58.986176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c6c4-89db-48be-8593-ec48e0f6e380 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:58.993508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:58.994782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:58.996012 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:58.996661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:59.015793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:59.019000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd03f9-0183-43f8-b420-8d825731d840 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:59.042393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1122/2262] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:02.278392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:02.278941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:02.278941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:02.300561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] MFA Rules not processed for user `464032d99d274cb3a9fe028634b47935`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:02.302047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:02.422302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1141/2263] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:04.117847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.118440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.118440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.150261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] MFA Rules not processed for user `d50395a72f664c84bc289ae04a71a5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:04.151781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:04.259202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1123/2264] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:04.264423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.279855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab80f09-75a2-49e7-99d7-8bf3577d7c89 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.284512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.285402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.285825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.286254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.287051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.289017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.323865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1142/2265] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:04 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:04.327739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.340170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d941d6af-7bcf-40fa-a6aa-acbe3380637c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.415458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.416217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.416364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.416624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.417795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.419759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.449080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1124/2266] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:04 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:04.450164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.474845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86ce55-9699-41d8-985e-da36f73ca1d4 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.480534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.481187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.481462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.481739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.482384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.484360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.496071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1143/2267] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:04.500185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.511326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fcc42-a7ef-445d-9a7d-c59a42a6115d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.516748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.517463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.517739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.518204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] PATH_INFO: `/v3/projects/6debace575564ef9a1594fe6fcc85db9/users/fc61eb61199a4c6b84da10fbe1ad7e17/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.538462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6debace575564ef9a1594fe6fcc85db9, user_id=fc61eb61199a4c6b84da10fbe1ad7e17, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.541229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.544978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:04.558618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1125/2268] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:04 2022] PUT /identity/v3/projects/6debace575564ef9a1594fe6fcc85db9/users/fc61eb61199a4c6b84da10fbe1ad7e17/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:04.563653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.575040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:04.579263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5528-3f47-4ecb-9f39-503b5b73f39a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.648196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.648839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.649128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.649402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.650140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.652442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee0d2fe-0b16-4db7-9186-da3eac6e026e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.669185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1144/2269] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:04.673885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:04.702555 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3116a5-ff30-4f96-8229-52661960db9f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:04.715748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:04.716719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:04.717027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:04.717302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] PATH_INFO: `/v3/projects/6debace575564ef9a1594fe6fcc85db9/users/fc61eb61199a4c6b84da10fbe1ad7e17/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:04.719327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6debace575564ef9a1594fe6fcc85db9, user_id=fc61eb61199a4c6b84da10fbe1ad7e17, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:04.722042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:04.734562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1126/2270] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:04 2022] PUT /identity/v3/projects/6debace575564ef9a1594fe6fcc85db9/users/fc61eb61199a4c6b84da10fbe1ad7e17/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:11.064726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771c89-0616-459a-9b10-c8826aaa0068 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:11.065744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771c89-0616-459a-9b10-c8826aaa0068 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:11.066435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c771c89-0616-459a-9b10-c8826aaa0068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:11.120480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5c771c89-0616-459a-9b10-c8826aaa0068 None None] MFA Rules not processed for user `fc61eb61199a4c6b84da10fbe1ad7e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:11.124030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5c771c89-0616-459a-9b10-c8826aaa0068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:11.268245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1145/2271] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:11.282213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:11.285484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:11.427215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6074d3-d0b8-4741-8266-e11f07826253 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:11.437624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:11.438820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:11.439283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:11.439563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:11.528615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:11.530462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:11.544282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1127/2272] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:13.196108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c3a-2ce3-4882-a35f-123f56b25e71 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:13.196669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c3a-2ce3-4882-a35f-123f56b25e71 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:13.196669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c3a-2ce3-4882-a35f-123f56b25e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:13.234401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bea42c3a-2ce3-4882-a35f-123f56b25e71 None None] MFA Rules not processed for user `d50395a72f664c84bc289ae04a71a5b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:13.235755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bea42c3a-2ce3-4882-a35f-123f56b25e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:13.247260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1146/2273] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:21.539059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:INSERT=2,keystone:SELECT=63 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:23.226335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=64 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:36.152870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:36.154544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:36.254495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93f19b-229b-429c-8b48-d203bd04cdd7 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:36.262153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:36.262853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.263129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.263430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] PATH_INFO: `/v3/users/925e09732db84c1e85d29245f95a9194` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.265089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925e09732db84c1e85d29245f95a9194)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:36.267196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:36.349535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925e09732db84c1e85d29245f95a9194'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:36.372345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925e09732db84c1e85d29245f95a9194'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:36.384597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925e09732db84c1e85d29245f95a9194'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:36.387345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925e09732db84c1e85d29245f95a9194'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:36.391046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925e09732db84c1e85d29245f95a9194'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:36.423467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1128/2274] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:26:36 2022] DELETE /identity/v3/users/925e09732db84c1e85d29245f95a9194 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:36.428083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.428653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.428653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.453805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:36.454360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:36.575064 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1147/2275] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:36.597513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:36.599616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:36.682691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072d961-ccaa-482e-bf86-f52c327f19a6 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:36.688794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:36.689670 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:36.690125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:36.690559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:36.702362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:36.703840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4901c9-efd0-4729-a0bf-12528c9f5817 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:36.715032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1129/2276] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:26:37.155169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.156857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:37.171607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766f4dc-c178-434b-bf04-e1ad1f2e2d36 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.176902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.177678 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.178023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.178380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] PATH_INFO: `/v3/projects/d55cf445cc814c2e81d385c6484c3dd6` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.179770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55cf445cc814c2e81d385c6484c3dd6)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.181882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.266024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55cf445cc814c2e81d385c6484c3dd6', 'request_id': 'req-f6821869-891f-4bd5-9f46-95a78037cec4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:37.275233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55cf445cc814c2e81d385c6484c3dd6', 'request_id': 'req-f6821869-891f-4bd5-9f46-95a78037cec4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:37.284412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55cf445cc814c2e81d385c6484c3dd6', 'request_id': 'req-f6821869-891f-4bd5-9f46-95a78037cec4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:37.298485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] The token cache is being invalidate because project d55cf445cc814c2e81d385c6484c3dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:26:37.298846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:37.299584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f6821869-891f-4bd5-9f46-95a78037cec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:37.301248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1148/2277] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:26:37 2022] DELETE /identity/v3/projects/d55cf445cc814c2e81d385c6484c3dd6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:26:37.308105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.308698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.309066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.337526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:37.339663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:37.368429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:37.432220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1130/2278] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:37.441365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.442286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.442286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.464914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:37.466385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:37.475590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1149/2279] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:37.481348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.494208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a09a2-8c8a-4dc4-8f6c-96649702e8d7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.502352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.503427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.503908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.504377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.505635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:26:37.506174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.509536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.534054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1131/2280] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:26:37.539048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.550027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72dbb9-6ec1-40ca-8615-2fdf9ea2a9a0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.555436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.556135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.556420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.556692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.557937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.559991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.605946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1150/2281] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:37 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:37.613015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.632745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36efa04-0fbe-46d2-b453-9dd97cfc786b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.756558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.757658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.758180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.758780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.759973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.764757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.807409 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1132/2282] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:37 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:37.812850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.828985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c64a-756c-4ca7-bf34-72689682b439 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.835138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.835964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.836372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.836756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.837607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.840049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.853333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1151/2283] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:26:37.859795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.874695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f141bcb-b02b-4f76-819b-9bfc7db85635 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.882392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.883461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.883824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.884241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.885912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.888896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2deff42-c5ab-4534-9dde-04c230a93428 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.908710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1133/2284] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:37.914309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:37.933099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0290a-6ca6-4da3-b164-e50a2c5c109c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:37.940690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:37.941775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:37.942206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:37.943429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] PATH_INFO: `/v3/projects/d32c6c6bf300400c9ddbbc881c16d1c2/users/02fde1e7aeab4b7187e73b18cd899380/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:37.967974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32c6c6bf300400c9ddbbc881c16d1c2, user_id=02fde1e7aeab4b7187e73b18cd899380, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:37.971110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:37.995508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1152/2285] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:37 2022] PUT /identity/v3/projects/d32c6c6bf300400c9ddbbc881c16d1c2/users/02fde1e7aeab4b7187e73b18cd899380/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:38.008692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.009487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.010126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.049562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] MFA Rules not processed for user `02fde1e7aeab4b7187e73b18cd899380`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:38.051546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:38.159505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1134/2286] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:38.165319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.196259 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:38.255673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6191d9a-cd9c-4b6d-a6c0-14e3a5a19a8c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.261723 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.262372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.262719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.262931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.263603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.265663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.302025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1153/2287] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:38 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:38.306693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.321657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edcb86-2941-41c7-9e1a-5e1f7a9a9dbd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.340688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:38.413944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.414518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.414793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.415066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.415737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.419054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.445465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1135/2288] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:38 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:26:38.450215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.461564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835477b9-2b33-4cef-b1c8-dd551192c47c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.467371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.468010 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.468284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.468584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.469267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.470953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.487692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1154/2289] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:26:38.489381 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.500662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5235a-3406-4a39-9742-a92a92a2f584 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.506570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.507599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.507935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.508213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] PATH_INFO: `/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c/users/d4e4cbbecc8d46619a1158948d52cccb/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.532021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c25d41bc20d4315a02dbca0fd8cf49c, user_id=d4e4cbbecc8d46619a1158948d52cccb, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.534809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.552662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1136/2290] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:38 2022] PUT /identity/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c/users/d4e4cbbecc8d46619a1158948d52cccb/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:38.557540 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.568575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1812-058d-44b3-8d0d-3f80d6b010d4 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.639766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.640469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.640760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.641083 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.641762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.643408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0e60-80d8-46dd-8b6d-367e14607435 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.662576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1155/2291] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:38.667107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.678686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030ae17-4aec-45fc-9e72-98515021d8d8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.685127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.686181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.686576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.686952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] PATH_INFO: `/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c/users/d4e4cbbecc8d46619a1158948d52cccb/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.690245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c25d41bc20d4315a02dbca0fd8cf49c, user_id=d4e4cbbecc8d46619a1158948d52cccb, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:38.694568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:38.710981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1137/2292] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:38 2022] PUT /identity/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c/users/d4e4cbbecc8d46619a1158948d52cccb/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:38.723276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.723719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.724214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:38.761457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] MFA Rules not processed for user `d4e4cbbecc8d46619a1158948d52cccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:38.763617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:38.864836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1156/2293] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:38.875442 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:38.877940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:38.965636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55a08-35d6-45e4-af75-a83d7a38c939 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:38.972077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:38.972718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:38.973025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:38.973292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:39.045882 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:39.047395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c0920-b5fb-49ae-931a-e38d8ac13255 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:39.058697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1138/2294] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:43.087377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:43.121294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:43.209027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565188-97b0-4b76-8856-d882f8fc681f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:43.218692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:43.219789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:43.220289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:43.220789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] PATH_INFO: `/v3/users/02fde1e7aeab4b7187e73b18cd899380` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:43.222887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02fde1e7aeab4b7187e73b18cd899380)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:43.225645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:43.299145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02fde1e7aeab4b7187e73b18cd899380'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:43.299965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02fde1e7aeab4b7187e73b18cd899380'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:43.311462 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02fde1e7aeab4b7187e73b18cd899380'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:43.312099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02fde1e7aeab4b7187e73b18cd899380'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:43.321431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02fde1e7aeab4b7187e73b18cd899380'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:43.352213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1157/2295] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:26:43 2022] DELETE /identity/v3/users/02fde1e7aeab4b7187e73b18cd899380 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:26:43.359019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:43.359933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:43.359933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:43.398237 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:43.400291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:43.443042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:43.535597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1139/2296] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:43.554564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:43.557637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:43.662523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c73aa-179b-47d1-ae3c-da10586535b5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:43.669373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:43.670018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:43.670450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:43.670733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:43.684206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:43.686853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:43.702042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1158/2297] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:44.229948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:44.232113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:44.263976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a692ef-9c5a-413e-bb63-7d12bceda5b8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:44.270093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:44.271006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.271282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.271557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] PATH_INFO: `/v3/projects/d32c6c6bf300400c9ddbbc881c16d1c2` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.272890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32c6c6bf300400c9ddbbc881c16d1c2)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:44.274850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:44.361758 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32c6c6bf300400c9ddbbc881c16d1c2', 'request_id': 'req-88741aa0-9e59-4a4f-bd36-ca1a51f92179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.376436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32c6c6bf300400c9ddbbc881c16d1c2', 'request_id': 'req-88741aa0-9e59-4a4f-bd36-ca1a51f92179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.390018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32c6c6bf300400c9ddbbc881c16d1c2', 'request_id': 'req-88741aa0-9e59-4a4f-bd36-ca1a51f92179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.409191 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] The token cache is being invalidate because project d32c6c6bf300400c9ddbbc881c16d1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:26:44.409580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.410648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.413144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1140/2298] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:26:44 2022] DELETE /identity/v3/projects/d32c6c6bf300400c9ddbbc881c16d1c2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:26:44.424447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:44.439875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb33f0-8bb7-4932-8046-b3f806b6a8c4 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:44.508590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:44.546313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:44.547125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:44.547498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:44.547836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] PATH_INFO: `/v3/users/d4e4cbbecc8d46619a1158948d52cccb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:44.549304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e4cbbecc8d46619a1158948d52cccb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:44.551816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:44.632410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e4cbbecc8d46619a1158948d52cccb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.633813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e4cbbecc8d46619a1158948d52cccb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.649692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e4cbbecc8d46619a1158948d52cccb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.652044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e4cbbecc8d46619a1158948d52cccb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.665638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-bfd6b97b-b649-4942-9316-0346e6ffd059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e4cbbecc8d46619a1158948d52cccb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:44.700772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1159/2299] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:26:44 2022] DELETE /identity/v3/users/d4e4cbbecc8d46619a1158948d52cccb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:45.217376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:45.219413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:45.252023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88741aa0-9e59-4a4f-bd36-ca1a51f92179 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:45.465248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:45.466962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.466962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.466962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] PATH_INFO: `/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.468313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c25d41bc20d4315a02dbca0fd8cf49c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:45.471395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:45.568277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c25d41bc20d4315a02dbca0fd8cf49c', 'request_id': 'req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:45.570380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:45.581948 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c25d41bc20d4315a02dbca0fd8cf49c', 'request_id': 'req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:45.594129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c25d41bc20d4315a02dbca0fd8cf49c', 'request_id': 'req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:45.613935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] The token cache is being invalidate because project 6c25d41bc20d4315a02dbca0fd8cf49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:26:45.614543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:45.615759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5479fa67-bb59-4e0b-b0bc-5156efdacdf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:45.617601 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1141/2300] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:26:45 2022] DELETE /identity/v3/projects/6c25d41bc20d4315a02dbca0fd8cf49c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:45.625485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.626329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.626518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.654268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:45.656252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:45.757470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1160/2301] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:45.770192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.770769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.771199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.807190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:45.809146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:45.821348 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:45.823140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1142/2302] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:45.824621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:45.828498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:45.840800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab93f0-8522-44b2-b262-f5632e57370f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:45.849001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:45.850089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.850582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.851072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.852242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:26:45.852702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:45.855983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:45.876394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1143/2303] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:26:45.882615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:45.902809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf54a3f-15c3-4e09-8577-e0e0996b0c2d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:45.910849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:45.911888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.912385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.913586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.914144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:45.915765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:45.918071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:45.949416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa27b15-5071-44ba-be5f-49f87a05bdea None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:45.958179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:45.958955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1144/2304] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:45 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:26:45.959207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:45.959621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:45.960115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:45.963623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:45.964324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:45.984870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:45.987911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.008729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1161/2305] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:26:46.076953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d0d62-34a1-42e5-8a8c-4b5a72899b58 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.085139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.086224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.086681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.087146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.088900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.092989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.137226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1145/2306] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:45 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:26:46.143992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.168280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffaf10-aa51-4618-919f-2e05c4f99692 service placement] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.178564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.180551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.180551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.181013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.183091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.187407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.212306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1162/2307] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:46.220035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.240612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb7760-56f1-40d1-a8b9-ad49a8a74849 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.250404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.251541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.252163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.252557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.253790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.257021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6191f8-3004-4449-85cf-0d0847962a00 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.280918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1146/2308] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:46.287789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.306713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e057ebe-fc65-4d53-9a7c-493ca35e88a3 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.315257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.316368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.316861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.317302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] PATH_INFO: `/v3/projects/6a022808082a4fc48dd0e06859a3071f/users/52b5a1f585f448819f8f1284d35dcf47/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.351016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a022808082a4fc48dd0e06859a3071f, user_id=52b5a1f585f448819f8f1284d35dcf47, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.356982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.376066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1163/2309] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:46 2022] PUT /identity/v3/projects/6a022808082a4fc48dd0e06859a3071f/users/52b5a1f585f448819f8f1284d35dcf47/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:46.382036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.382519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.383016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.411929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:46.414107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:46.474614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.478117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:46.544421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1147/2310] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:46.566124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.568300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:46.594005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c487a-9dc1-4362-9158-39432dd5c44b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.601385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.602102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.602481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.604748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:46.605467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] PATH_INFO: `/v3/users/118411d6e1674531a381bb0aa9960b99` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.607290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118411d6e1674531a381bb0aa9960b99)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.610586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.667218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac4f7-2e86-4752-9841-aa62182f9a19 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:46.671544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:46.672172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.672445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.672799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.685489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:46.685795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118411d6e1674531a381bb0aa9960b99'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:46.686547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118411d6e1674531a381bb0aa9960b99'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:46.687173 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ded26-e129-4532-9f20-844b021071e7 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:46.697984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118411d6e1674531a381bb0aa9960b99'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:46.698677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118411d6e1674531a381bb0aa9960b99'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:46.701781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1148/2311] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:26:46.707387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118411d6e1674531a381bb0aa9960b99'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:46.732711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1164/2312] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:26:46 2022] DELETE /identity/v3/users/118411d6e1674531a381bb0aa9960b99 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:46.738216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416a37-64fe-416a-9838-33726565e48a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:46.738510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416a37-64fe-416a-9838-33726565e48a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:46.738818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416a37-64fe-416a-9838-33726565e48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:46.770444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-db416a37-64fe-416a-9838-33726565e48a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:46.772606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-db416a37-64fe-416a-9838-33726565e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:46.898631 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1149/2313] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:46.930442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:46.933582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:47.007036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:47.080032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142d810-c30e-451b-b019-a15ce84c4390 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:47.093939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:47.096324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:47.097039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:47.097653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:47.133770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:47.137886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d153b7f-a222-4c88-9438-773c31cda182 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:47.161893 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1165/2314] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:48.269398 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416a37-64fe-416a-9838-33726565e48a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:48.271894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-db416a37-64fe-416a-9838-33726565e48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.294405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416a37-64fe-416a-9838-33726565e48a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:48.308553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:48.309979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.310928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.311444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] PATH_INFO: `/v3/projects/fdd2c8f4cef04570b3ed5da4039f9ed2` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.314328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd2c8f4cef04570b3ed5da4039f9ed2)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:48.320220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:48.359523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.360667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.361580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.431158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] MFA Rules not processed for user `52b5a1f585f448819f8f1284d35dcf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:48.435384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.537651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd2c8f4cef04570b3ed5da4039f9ed2', 'request_id': 'req-9936fda1-0734-4aa0-9806-63350d647379'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:48.573898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd2c8f4cef04570b3ed5da4039f9ed2', 'request_id': 'req-9936fda1-0734-4aa0-9806-63350d647379'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:48.594443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd2c8f4cef04570b3ed5da4039f9ed2', 'request_id': 'req-9936fda1-0734-4aa0-9806-63350d647379'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:48.625745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1166/2315] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:48.626310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] The token cache is being invalidate because project fdd2c8f4cef04570b3ed5da4039f9ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:26:48.626572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:48.631227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9936fda1-0734-4aa0-9806-63350d647379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:48.634355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1150/2316] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:26:48 2022] DELETE /identity/v3/projects/fdd2c8f4cef04570b3ed5da4039f9ed2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:48.640463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:48.642837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.643618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fdd4-025c-4d9b-9a8f-ff1c1bd7aa79 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.644320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fdd4-025c-4d9b-9a8f-ff1c1bd7aa79 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.644910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5fdd4-025c-4d9b-9a8f-ff1c1bd7aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.680018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3bf5fdd4-025c-4d9b-9a8f-ff1c1bd7aa79 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:48.683006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3bf5fdd4-025c-4d9b-9a8f-ff1c1bd7aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.767546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:48.787449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2a237-de8a-4bcc-a5fa-d3418489e7ec None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:48.829121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1151/2317] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:48.838823 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36797fc7-4688-44c9-b272-c95989901989 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.839115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36797fc7-4688-44c9-b272-c95989901989 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.839379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36797fc7-4688-44c9-b272-c95989901989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.881808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-36797fc7-4688-44c9-b272-c95989901989 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:48.885401 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-36797fc7-4688-44c9-b272-c95989901989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.908748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1152/2318] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:48.910132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36797fc7-4688-44c9-b272-c95989901989 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:48.912280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:48.913694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.914343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.914971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.922739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:48.925629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36797fc7-4688-44c9-b272-c95989901989 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:48.935077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:48.935847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:48.937172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:48.938092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:48.941058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:26:48.941942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:48.950064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:48.983658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1153/2319] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:26:48.988731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.005771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29da58-e7d4-46d2-aa80-364f90c807ac admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.015220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.016632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.017242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.018042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.018991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.023437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.039919 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:49.098943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1154/2320] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:48 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:26:49.104585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.126771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.133147 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.159181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1167/2321] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:49.215037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc496d9-50a8-4230-b9fc-485c00271916 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.221276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.222262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.222674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.223023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.223780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.226183 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.257997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1155/2322] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:49 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:49.264904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.285187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73879360-8980-4ef7-8ee4-071b4d58d521 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.308511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.314202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.315494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.315494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.316742 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.326222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.354335 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1168/2323] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:49.359678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.376927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15362199-8db4-4b28-9bea-989763eb4d0b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.386443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.387869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.389444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.389804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.391100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.392934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085222-0f0b-4b86-a059-1934c5ec5f6d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.411340 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1156/2324] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:26:49.417825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.437324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793d2d8-0a6f-4362-9a41-0269ba2a6a7b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.446431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.448527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.449095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.449575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] PATH_INFO: `/v3/projects/09c0837a22684cb786401e27679ce77b/users/edaccf0ecc56438595d3540efed4a683/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.489590 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c0837a22684cb786401e27679ce77b, user_id=edaccf0ecc56438595d3540efed4a683, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.495694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.518771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1169/2325] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:49 2022] PUT /identity/v3/projects/09c0837a22684cb786401e27679ce77b/users/edaccf0ecc56438595d3540efed4a683/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:49.531061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.531415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.531824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.570804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] MFA Rules not processed for user `edaccf0ecc56438595d3540efed4a683`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:49.573110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:49.707809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1157/2326] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:49.776291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:49.780360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:49.922998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedef669-59a4-490d-84f2-2da4b0fd2a00 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:49.930140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:49.931176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:49.931681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:49.932190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:49.953061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:49.956269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df96d5-e1c2-4bd5-b204-5b64e2ecc1bd service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:49.991492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1170/2327] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:50.028535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:50.049270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:50.170186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c9ea7-864c-41f6-bd7c-379d07f45d0d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:50.176316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:50.177033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.177329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.177602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] PATH_INFO: `/v3/users/edaccf0ecc56438595d3540efed4a683` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.179338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edaccf0ecc56438595d3540efed4a683)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:50.182498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:50.311571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edaccf0ecc56438595d3540efed4a683'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:50.341180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edaccf0ecc56438595d3540efed4a683'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:50.359060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edaccf0ecc56438595d3540efed4a683'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:50.361292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edaccf0ecc56438595d3540efed4a683'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:50.363063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edaccf0ecc56438595d3540efed4a683'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:50.406423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1158/2328] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:26:50 2022] DELETE /identity/v3/users/edaccf0ecc56438595d3540efed4a683 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:50.421430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.422469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.422935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.459931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:50.465722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:50.623192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1171/2329] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:50.641527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:50.644157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:50.766254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d746f-9d06-4522-b221-87614db4c924 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:50.773967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:50.775425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:50.776874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:50.777074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:50.795490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:50.798475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1d5d-4904-495a-8697-bd4d7de7f2cd service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:50.818721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1159/2330] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:51.268007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:51.270499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:51.293164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d748f2-6107-4b35-8db3-3d69c48bb6aa None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:51.299456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:51.300439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.300923 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.301410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] PATH_INFO: `/v3/projects/09c0837a22684cb786401e27679ce77b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.304157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c0837a22684cb786401e27679ce77b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:51.308574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:51.377220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:51.389954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c0837a22684cb786401e27679ce77b', 'request_id': 'req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:51.401422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c0837a22684cb786401e27679ce77b', 'request_id': 'req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:51.412592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c0837a22684cb786401e27679ce77b', 'request_id': 'req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:51.435350 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] The token cache is being invalidate because project 09c0837a22684cb786401e27679ce77b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:26:51.436472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:51.436472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-b30c3f6b-eb5b-4bc9-8f1a-f1631a75b8ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:26:51.438622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1172/2331] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:26:51 2022] DELETE /identity/v3/projects/09c0837a22684cb786401e27679ce77b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:26:51.446113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.447740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.447740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.476070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:51.477444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:51.521548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:51.579149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1160/2332] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:51.592508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.593787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.593787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.623928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:51.625310 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:51.640297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1173/2333] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:51.647485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:51.667701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49966eb-452d-45af-b620-66ddcd6bd7ed None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:51.676368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:51.677753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.679519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.680001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.682208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:26:51.682834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:51.687116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:51.714848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1161/2334] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:26:51.720745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:51.746184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ed360-9cd5-44e4-8876-dc8bea172451 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:51.751601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:51.752270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.752548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.752846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.753578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:51.755797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd47dd-ee25-4f6b-8f27-40bcac565342 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:51.801909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1174/2335] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:26:51 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:26:51.808858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:51.822455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71401-74e5-4f71-98da-a4545d2c2ae2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:51.928688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:51.929594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.929871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.930139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.930928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:51.933621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:51.966613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:51.968475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:51.969104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:51.980096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1162/2336] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:26:51 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:26:51.983159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:51.999732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] MFA Rules not processed for user `52b5a1f585f448819f8f1284d35dcf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:52.001785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:52.005110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d861d61-218d-493f-961a-7a31c4100c0b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:52.015109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:52.016250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:52.016731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:52.017280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:52.018526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:52.022017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:52.048523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1163/2337] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:26:52.051683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:52.070068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb81ed-1db6-4c9b-a5b2-93f839fa2297 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:52.079529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:52.080598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:52.081096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:52.081570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:52.082740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:52.085898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da3f9b-0646-470c-ac0a-4e530b3fe989 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:52.093639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1175/2338] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:52.107695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1164/2339] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:26:52.113099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:52.127762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ca1a8-a42a-4044-aa3e-8731c20c08c6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:52.133595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:52.134322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:52.135240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:52.135722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] PATH_INFO: `/v3/projects/1ffff557177647a1b2d7dfbae3e611e3/users/9fbf8b65ad1740e485d75c572e745c51/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:52.161190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ffff557177647a1b2d7dfbae3e611e3, user_id=9fbf8b65ad1740e485d75c572e745c51, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:52.167455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:52.192065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1176/2340] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:26:52 2022] PUT /identity/v3/projects/1ffff557177647a1b2d7dfbae3e611e3/users/9fbf8b65ad1740e485d75c572e745c51/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:26:52.200544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59efa91-9ba5-416e-a9f5-59fa0b471943 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:52.201048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59efa91-9ba5-416e-a9f5-59fa0b471943 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:52.201491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59efa91-9ba5-416e-a9f5-59fa0b471943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:52.231923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d59efa91-9ba5-416e-a9f5-59fa0b471943 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:52.233285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d59efa91-9ba5-416e-a9f5-59fa0b471943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:52.319165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1165/2341] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:52.334161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:52.337165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:52.435175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6ec5e-9f76-4a9b-8ad1-6b69e947fce8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:52.442470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:52.443679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:52.444058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:52.444563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:52.464780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:52.466204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:52.481053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1177/2342] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:53.548829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532837f-2e0d-4359-a380-cafa32cac7e7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:53.549656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532837f-2e0d-4359-a380-cafa32cac7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:53.549935 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532837f-2e0d-4359-a380-cafa32cac7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:53.602256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f532837f-2e0d-4359-a380-cafa32cac7e7 None None] MFA Rules not processed for user `9fbf8b65ad1740e485d75c572e745c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:53.604981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f532837f-2e0d-4359-a380-cafa32cac7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:53.623693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:53.706651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1166/2343] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:26:53.722417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:53.724220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:53.754879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:53.822530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c2e85-f0de-4d68-a18e-53a6c1baa02c service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:53.828327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:53.829145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:53.829568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:53.830071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:53.846725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:53.849648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:53.868521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1178/2344] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:55.322560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d351d-aa96-4c8b-8d62-ac168d319e7c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:55.323471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d351d-aa96-4c8b-8d62-ac168d319e7c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:55.323471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d351d-aa96-4c8b-8d62-ac168d319e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:55.346730 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4b3d351d-aa96-4c8b-8d62-ac168d319e7c None None] MFA Rules not processed for user `9fbf8b65ad1740e485d75c572e745c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:55.348093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4b3d351d-aa96-4c8b-8d62-ac168d319e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:55.356983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1167/2345] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:26:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:03.861058 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=17 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:05.052345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:05.074293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2878703-8a7b-48d3-9f27-85e82780a744 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:05.082437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:05.082437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:05.082437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:05.083032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:05.086777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:05.217107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:05.219332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ce9b4-f450-4fac-8a61-c03591ee5f41 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:05.239600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1179/2346] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:05.339559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=23 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:15.230226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=30 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:25.178642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:25.179777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:25.179777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:25.213136 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] MFA Rules not processed for user `52b5a1f585f448819f8f1284d35dcf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:25.215692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:25.307549 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1168/2347] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:27:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:35.301712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=25 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:35.720566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66181-9d91-42e6-879c-ff76c7433afd None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:35.721747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66181-9d91-42e6-879c-ff76c7433afd None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:35.722180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d66181-9d91-42e6-879c-ff76c7433afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:35.748799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e1d66181-9d91-42e6-879c-ff76c7433afd None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:35.750727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e1d66181-9d91-42e6-879c-ff76c7433afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:35.867176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1180/2348] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:27:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:27:35.962674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:35.965709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:36.079192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f55897-60d9-43e9-8158-d745eb3ed760 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:36.085001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:36.085660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:36.085942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:36.086212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:36.103366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:36.105644 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:36.125492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1169/2349] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:27:45.848097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=25 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:46.117064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=32 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:27:54.107486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341373-59f0-4b12-818c-86b08ed408a1 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.108421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341373-59f0-4b12-818c-86b08ed408a1 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.108421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341373-59f0-4b12-818c-86b08ed408a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.145428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e3341373-59f0-4b12-818c-86b08ed408a1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:54.147902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e3341373-59f0-4b12-818c-86b08ed408a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:54.161745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1181/2350] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:54.198481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:54.202211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:54.343532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd183277-1811-4ac0-9611-78a1e48a7fa3 service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:54.355172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:54.356308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:54.356834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:54.357355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:54.373874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:54.377206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:54.397975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1170/2351] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:27:56.908887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9ce3-5ecb-43b9-aacd-2b56be931909 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:56.913205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9ce3-5ecb-43b9-aacd-2b56be931909 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:56.913887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca9ce3-5ecb-43b9-aacd-2b56be931909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:56.950170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c7ca9ce3-5ecb-43b9-aacd-2b56be931909 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:56.951378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c7ca9ce3-5ecb-43b9-aacd-2b56be931909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:56.963234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1182/2352] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:27:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:56.983193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:56.998370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fec23-7c84-4a50-8998-f98a35ca65c4 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:27:57.005199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:27:57.006060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:57.006416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:57.006851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:57.026723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:27:57.029685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d18cdd-532d-4058-99bd-6049361ed0b4 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:27:57.054222 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1171/2353] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:27:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:27:59.806829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.807719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.807719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.809910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1183/2354] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:27:59.832598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc855-86cc-4baf-8797-67856a2a321b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:27:59.839359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc855-86cc-4baf-8797-67856a2a321b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:27:59.840459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc855-86cc-4baf-8797-67856a2a321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:27:59.902088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b16bc855-86cc-4baf-8797-67856a2a321b None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:27:59.904761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b16bc855-86cc-4baf-8797-67856a2a321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:27:59.957979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1172/2355] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:27:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:27:59.983701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:27:59.988256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.202779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dd7f6-521f-4eb8-aa6f-29d3a0125f86 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.221444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.222513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.222965 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.224431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.276524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.280746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6d884-bafa-47a7-a99a-07b03ba2478a service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.316311 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1184/2356] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:27:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:00.481509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38ea95-1561-45fc-ba6a-af93d5ae6c5e None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.482009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38ea95-1561-45fc-ba6a-af93d5ae6c5e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.482509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38ea95-1561-45fc-ba6a-af93d5ae6c5e None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.486413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1173/2357] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:28:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:00.499218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb154c9-ada9-4fd5-8487-ad774ca4f2e6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.501098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb154c9-ada9-4fd5-8487-ad774ca4f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.501904 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb154c9-ada9-4fd5-8487-ad774ca4f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.568308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-5eb154c9-ada9-4fd5-8487-ad774ca4f2e6 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:00.572528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5eb154c9-ada9-4fd5-8487-ad774ca4f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.589055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1185/2358] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:00.609877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38ea95-1561-45fc-ba6a-af93d5ae6c5e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:00.639480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38ea95-1561-45fc-ba6a-af93d5ae6c5e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:00.646527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:00.648050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.648920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.651314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.669892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:00.673796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b9ec7-9e4c-47c3-b82b-e9bf1f635102 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:00.701068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1174/2359] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:00.891124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfe6e2-346b-4c61-966f-1d1157c93ae8 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.892733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfe6e2-346b-4c61-966f-1d1157c93ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.893680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfe6e2-346b-4c61-966f-1d1157c93ae8 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.897126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1186/2360] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:28:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:28:00.909530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.910427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.910427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:00.953677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:00.955918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:00.966671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:00.967969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:00.968930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.037187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1175/2361] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:01.080364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.125177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:01.128150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:01.135068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef9c6b-00b4-4644-adbd-90e16655022f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.142410 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.145023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.145909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.147891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.174958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1187/2362] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:01.191711 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.194797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2ea8f-417b-49d3-bfed-a1fd0755e89c service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.242307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1176/2363] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:01.264355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:01.306417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb86a1f-5130-4880-9faa-c46dac080d82 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:01.334178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:01.335233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:01.335675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:01.336304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:01.367857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:01.371856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:01.409130 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1188/2364] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:05.708260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c8ee-3ad3-4ce5-b525-bacca902a948 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.725934 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c8ee-3ad3-4ce5-b525-bacca902a948 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.728278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7c8ee-3ad3-4ce5-b525-bacca902a948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.772172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-10c7c8ee-3ad3-4ce5-b525-bacca902a948 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:05.776548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-10c7c8ee-3ad3-4ce5-b525-bacca902a948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:05.799714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1177/2365] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:05.841059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:05.843988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:05.902741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7aa318-f5c7-4077-9f8a-c5c9a3b87dd9 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:05.930126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:05.932627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:05.933436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:05.933990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:05.971322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:05.975621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:06.016663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1189/2366] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:09.936779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05987-855a-4ac1-84b7-2a911c45e6e3 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:09.938547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05987-855a-4ac1-84b7-2a911c45e6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:09.939501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b05987-855a-4ac1-84b7-2a911c45e6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:09.996236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-24b05987-855a-4ac1-84b7-2a911c45e6e3 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:09.999654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-24b05987-855a-4ac1-84b7-2a911c45e6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:10.023067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1178/2367] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:28:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:10.048519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:10.082019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfe9a-c881-408e-87a1-5a8479f5a15a service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:10.088327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74077-c16c-47c0-bd0b-8b23b5c31fea None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.090292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74077-c16c-47c0-bd0b-8b23b5c31fea None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.091624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74077-c16c-47c0-bd0b-8b23b5c31fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.093252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:10.094364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.094862 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.095354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.113547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:10.117011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:10.140381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1190/2368] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:28:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:28:10.146061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-23a74077-c16c-47c0-bd0b-8b23b5c31fea None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:10.152329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-23a74077-c16c-47c0-bd0b-8b23b5c31fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:10.176959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1179/2369] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:10.216986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:10.277830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc02eb-2da4-45b8-98bf-f9851266de7a service swift] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:10.326298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:10.328344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:10.329640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:10.330548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:10.389539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:10.393302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:10.427846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1191/2370] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:28:20.133509 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=67 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:20.416298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=62 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:22.387360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598e3c-3a3a-4a8c-b286-5b150875b0fb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.388188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598e3c-3a3a-4a8c-b286-5b150875b0fb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.388558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598e3c-3a3a-4a8c-b286-5b150875b0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.485744 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-d8598e3c-3a3a-4a8c-b286-5b150875b0fb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:22.490544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d8598e3c-3a3a-4a8c-b286-5b150875b0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:22.514611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1180/2371] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:22.553996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:22.583872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad67ac-c226-4a36-90a3-4b5fe7ebe277 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:22.596207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:22.597624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:22.598158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:22.598660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:22.614806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:22.619225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:22.642447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1192/2372] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:24.740414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:24.741591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:24.741591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:24.775337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:24.777781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:24.790907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1181/2373] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:28:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:24.810283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:24.827842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500c27a-9d1d-40a3-9355-6700351d465e service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:24.835542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:24.836642 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:24.837119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:24.837405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:24.849068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:24.850980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:24.862371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1193/2374] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:28:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:28:28.001967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:28.006971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:28.037827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105ad6d-0b99-4bf2-9739-be5c13efcfb8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:28.048096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:28.049554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.050087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.050636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] PATH_INFO: `/v3/users/52b5a1f585f448819f8f1284d35dcf47` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.053759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b5a1f585f448819f8f1284d35dcf47)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:28.058710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:28.161083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b5a1f585f448819f8f1284d35dcf47'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.188092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b5a1f585f448819f8f1284d35dcf47'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.204587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b5a1f585f448819f8f1284d35dcf47'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.205993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b5a1f585f448819f8f1284d35dcf47'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.207435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-5db63f98-d563-45e5-bc72-7eb9bc6e2489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b5a1f585f448819f8f1284d35dcf47'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.235058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1182/2375] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:28:28 2022] DELETE /identity/v3/users/52b5a1f585f448819f8f1284d35dcf47 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:28.547361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:28.571149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef124a2-9b12-4bde-a568-03364909dc6d service swift] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:28.707996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:28.709467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.709813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.710280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] PATH_INFO: `/v3/projects/6a022808082a4fc48dd0e06859a3071f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.713219 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a022808082a4fc48dd0e06859a3071f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:28.717089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:28.814834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a022808082a4fc48dd0e06859a3071f', 'request_id': 'req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.832417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a022808082a4fc48dd0e06859a3071f', 'request_id': 'req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.847736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a022808082a4fc48dd0e06859a3071f', 'request_id': 'req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.872211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] The token cache is being invalidate because project 6a022808082a4fc48dd0e06859a3071f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:28:28.872738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.874232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f4c1f8d9-441c-4cdd-90f9-4e71dd0cf897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:28:28.877016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1194/2376] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:28:28 2022] DELETE /identity/v3/projects/6a022808082a4fc48dd0e06859a3071f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:28:28.885925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:28.886418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:28.886909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:28.916791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:28.918675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:29.012925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1183/2377] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:29.022875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.023193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.023466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.049464 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:29.051369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:29.062662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1195/2378] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:29.072956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.088329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078fa1-8163-49b0-9aa5-437236eb12ee None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.094407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.095203 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.095559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.095868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.096629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:28:29.097038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.099192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.115621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1184/2379] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:28:29.123224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.139853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fc79e-7b62-4251-a54d-52f25a46aa07 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.147903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.149176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.149614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.149959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.151113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.155193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.210538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1196/2380] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:28:29 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:29.216512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.236709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec384c-3575-4e75-bd63-975e926ed1a2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.312005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:29.338845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.339673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.340046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.340523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.341349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.343652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.374357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1185/2381] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:28:29 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:28:29.380126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.402131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ded59-91cc-42ec-b190-152de3a4b68d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.408363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.409098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.409493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.409901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.410709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.412547 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.435777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1197/2382] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:28:29.440950 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.455062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf1e89-f700-4a2d-9732-e8039e663c6e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.461521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.462241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.462498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.462769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.463507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.465475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1292e-d30b-4f67-87f0-c52a19e0b2d1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.482262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1186/2383] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:28:29.488094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.511578 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3b899-4a01-4249-8dbd-e3ee132baf61 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.520114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.521153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.521589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.522034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] PATH_INFO: `/v3/projects/d795b6e9e2fb4a9eaa397796e9e3ddd5/users/5bd5f6d172e24196af5f5d0b7360a384/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.551937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d795b6e9e2fb4a9eaa397796e9e3ddd5, user_id=5bd5f6d172e24196af5f5d0b7360a384, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.559175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.575173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:29.582434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1198/2384] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:28:29 2022] PUT /identity/v3/projects/d795b6e9e2fb4a9eaa397796e9e3ddd5/users/5bd5f6d172e24196af5f5d0b7360a384/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:28:29.596406 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223347-f0ac-49ca-a02e-883547ec852a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.596681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223347-f0ac-49ca-a02e-883547ec852a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.597011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59223347-f0ac-49ca-a02e-883547ec852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.639486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-59223347-f0ac-49ca-a02e-883547ec852a None None] MFA Rules not processed for user `5bd5f6d172e24196af5f5d0b7360a384`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:29.640946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-59223347-f0ac-49ca-a02e-883547ec852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:29.775139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1187/2385] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:28:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:28:29.803059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:29.807364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:29.931215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284c85e-24c9-4c25-aed4-493b6af752aa admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:29.938869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:29.939962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:29.940468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:29.941051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:29.958048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:29.961670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:29.981316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1199/2386] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:35.260025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:35.261031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:35.261031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:35.299635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:35.301829 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:35.442022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1188/2387] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:35.477524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:35.479997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:35.635072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69caec7-d7f8-4b53-94ad-3f7834235464 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:35.645969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:35.647097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:35.647782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:35.648292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:35.667558 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:35.670406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:35.690611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1200/2388] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:37.654459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:37.657288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:37.753413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:37.754276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad6fa-9724-450f-b8b5-7045359b0a9b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:37.760465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.761338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.761576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.761907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.764856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:37.776974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191bce05-ad3e-424f-9c68-3b79ea9ba9f7 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:37.783981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:37.785217 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:37.785679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:37.786381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:37.790755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:37.796757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.800998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698384e4-7731-406a-bccd-9563449d6249 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.811594 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:37.815092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:37.818675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:37.828335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1189/2389] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:37.841035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1201/2390] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:41.870399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:41.871217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:41.871664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:41.907676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:41.910053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:42.028255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1190/2391] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:28:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:28:42.057550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:42.058939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:42.176851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b782ac-b58e-44af-8018-d6f6d3a1a67e service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:42.186797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:42.187922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:42.188345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:42.188782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:42.207941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:42.211568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:42.229001 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1202/2392] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:28:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:28:48.473308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:48.475545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:48.507146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2958e57-4126-4e45-bbd6-f4ef2c50af66 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:48.516888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:48.517983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:48.518498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:48.518994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:48.522069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:48.638326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:48.640335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcdee6-eabb-4171-9bcb-062a82ff3bd7 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:48.655831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1191/2393] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:52.221263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:56.952539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:56.974149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac9f9-7d84-44d0-b389-221fa3d63586 service swift] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:56.984969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:56.985452 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:56.985913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:56.986461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:56.989655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:57.097943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:57.100709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:57.117369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1203/2394] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:58.646308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=54 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:59.430349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:59.430349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:59.430349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:59.457333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] MFA Rules not processed for user `9fbf8b65ad1740e485d75c572e745c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:28:59.459615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:59.561272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1192/2395] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:28:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:00.124650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:00.142183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec67665-3ecd-4706-be35-087520e90897 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:00.150314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:00.151570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:00.152258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:00.152889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:00.156150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.176851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:00.179826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:00.198164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1204/2396] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:29:00.740108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:00.743174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.875861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c4a19-d07a-4630-ba1b-319845f63622 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:00.882192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:00.883640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:00.883993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:00.884495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:00.887499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:00.904599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:00.907011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:00.921023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1193/2397] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:10.189293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=34 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:10.913788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=57 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:12.143068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.149559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.181008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc28c7f-c0da-4986-b525-25832d2241bf service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.186373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a348a4-112d-4781-9f53-140b85acfcc2 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.188217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.189501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.189985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.190912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.196178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.211605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.212650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.213421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.214213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] PATH_INFO: `/v3/users/5bd5f6d172e24196af5f5d0b7360a384` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.217035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bd5f6d172e24196af5f5d0b7360a384)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.218202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.221064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf25e7-e2b6-4db6-a1ec-878180c1d1de service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.221790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.243338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1194/2398] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:12.344258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd5f6d172e24196af5f5d0b7360a384'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.345515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd5f6d172e24196af5f5d0b7360a384'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.363688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd5f6d172e24196af5f5d0b7360a384'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.365374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd5f6d172e24196af5f5d0b7360a384'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.376028 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd5f6d172e24196af5f5d0b7360a384'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:12.420973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1205/2399] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:12 2022] DELETE /identity/v3/users/5bd5f6d172e24196af5f5d0b7360a384 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:12.427947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.428630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.430389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.457566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:12.458818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.566945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1195/2400] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:12.584781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:12.588724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:12.703668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be90d-67a5-43c6-a871-6a1fa22432c8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:12.710997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:12.712286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:12.712725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:12.713253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:12.730247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:12.732993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021254b-4816-425b-8fc3-8538d6f08f02 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:12.752061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1206/2401] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:13.226916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.229637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.255411 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649325a-6e09-4bf6-8087-d449c3cd2cf8 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.264444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.265984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.266764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.267592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] PATH_INFO: `/v3/projects/d795b6e9e2fb4a9eaa397796e9e3ddd5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.272729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d795b6e9e2fb4a9eaa397796e9e3ddd5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.278155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.369248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd795b6e9e2fb4a9eaa397796e9e3ddd5', 'request_id': 'req-020279d6-ec63-4fa4-9fa9-16a258c95ee4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:13.378003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd795b6e9e2fb4a9eaa397796e9e3ddd5', 'request_id': 'req-020279d6-ec63-4fa4-9fa9-16a258c95ee4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:13.387384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd795b6e9e2fb4a9eaa397796e9e3ddd5', 'request_id': 'req-020279d6-ec63-4fa4-9fa9-16a258c95ee4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:13.409150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] The token cache is being invalidate because project d795b6e9e2fb4a9eaa397796e9e3ddd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:13.409672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:13.410821 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-020279d6-ec63-4fa4-9fa9-16a258c95ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:13.413679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1196/2402] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:13 2022] DELETE /identity/v3/projects/d795b6e9e2fb4a9eaa397796e9e3ddd5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:29:15.325962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:15.326853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:15.326853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:15.348992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] MFA Rules not processed for user `464032d99d274cb3a9fe028634b47935`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:15.351737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:15.446034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1207/2403] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:29:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:23.402170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:25.043842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.045067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.045067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.070006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:25.072129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.151794 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1197/2404] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:25.179571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.182449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.228303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:25.303360 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1745-85a1-4244-8e64-51a1f0823825 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.309331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.309972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.310249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.310523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.320329 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.322400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed3f15-a00e-4c39-a564-8905d0ea084e service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.334783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1208/2405] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:25.529039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:25.531103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.558311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7e7f5-9fd2-4275-b69c-2e62aaefd104 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:25.569855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:25.570947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:25.571435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:25.572217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:25.576065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:25.599325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:25.603016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:25.623873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1198/2406] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:29.642498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f828-ee1c-4814-9c7b-c0c79391824c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:29.643285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f828-ee1c-4814-9c7b-c0c79391824c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:29.644338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52f828-ee1c-4814-9c7b-c0c79391824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:29.677140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bb52f828-ee1c-4814-9c7b-c0c79391824c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:29.678662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bb52f828-ee1c-4814-9c7b-c0c79391824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:29.693043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1209/2407] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:29.720949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:29.737416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc34a0-3f13-4c90-ad60-9e5b85fe005e service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:29.748000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:29.749121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:29.749617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:29.750102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:29.767245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:29.770430 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:29.789966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1199/2408] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:33.789856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2074-9fe8-4c84-b2ce-02e945c8194e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:33.790479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2074-9fe8-4c84-b2ce-02e945c8194e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:33.790479 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2074-9fe8-4c84-b2ce-02e945c8194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:33.822898 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8afa2074-9fe8-4c84-b2ce-02e945c8194e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:33.824303 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8afa2074-9fe8-4c84-b2ce-02e945c8194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:33.837256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1210/2409] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:33.869617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:33.891953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cc8b3-8d2a-4560-864f-f01ec23f7895 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:33.903034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:33.904090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:33.904582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:33.905096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:33.923200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:33.926201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:33.946909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1200/2410] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:39.200096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde986a-8882-4183-ad3f-cfac20639765 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:39.201037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde986a-8882-4183-ad3f-cfac20639765 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:39.201037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde986a-8882-4183-ad3f-cfac20639765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:39.227123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8bde986a-8882-4183-ad3f-cfac20639765 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:39.229139 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8bde986a-8882-4183-ad3f-cfac20639765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:39.238690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1211/2411] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:39.276923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:39.299810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150826-79e8-47a2-987b-04ff0557ab51 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:39.311035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:39.312199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:39.312708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:39.313231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:39.330534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:39.332472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:39.354050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1201/2412] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:43.438733 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:43.439704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:43.439704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:43.468103 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:43.469841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:43.480037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1212/2413] 10.222.0.71 () {58 vars in 1016 bytes} [Tue Aug 23 22:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:43.506582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:43.519102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28c410-c0f8-4a0b-a921-0bbbc5c61e44 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:43.532422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83132-c364-4253-9263-114451e8c237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:43.533220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83132-c364-4253-9263-114451e8c237 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:43.533531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83132-c364-4253-9263-114451e8c237 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:43.533807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83132-c364-4253-9263-114451e8c237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:43.545145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f83132-c364-4253-9263-114451e8c237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:43.547096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f83132-c364-4253-9263-114451e8c237 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:43.569884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1202/2414] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:53.460361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=37 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:53.554059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=57 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:56.963828 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:57.042990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e859eb87-460b-4738-9c41-fbaff64cabd6 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:57.054760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:57.056508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:57.056508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:57.057120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:57.060663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:57.130861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:57.133325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e4c05-f6f9-4ced-949d-0b9edee25f0c service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:57.157143 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1213/2415] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:03.663528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83132-c364-4253-9263-114451e8c237 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:03.739945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83132-c364-4253-9263-114451e8c237 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:03.750534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:03.751664 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:03.752145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:03.752671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:03.755872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:03.870628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:03.873932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:03.893403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1203/2416] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:07.144857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=28 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:13.885144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=42 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:15.744358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:15.745332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:15.745332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:15.779158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] MFA Rules not processed for user `f3095b1ac2464cf8b9302eea60ba2c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:15.782059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:15.799486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1214/2417] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:30:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:20.172951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:20.174895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:20.247657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:20.251454 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:20.322097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80371e0-e04f-47bf-aa81-78af9d717384 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:20.329372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:20.330143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:20.330424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:20.330803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:20.333564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:20.357035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:20.359643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923787e3-2379-4f87-be9b-4b56f1bd945c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:20.360271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:20.367658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:20.368854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:20.369358 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:20.369866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] PATH_INFO: `/v3/users/9fbf8b65ad1740e485d75c572e745c51` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:20.372175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbf8b65ad1740e485d75c572e745c51)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:20.379158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:20.382604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1204/2418] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:20.488266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbf8b65ad1740e485d75c572e745c51'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:20.489553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbf8b65ad1740e485d75c572e745c51'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:20.505114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbf8b65ad1740e485d75c572e745c51'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:20.506984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbf8b65ad1740e485d75c572e745c51'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:20.523339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbf8b65ad1740e485d75c572e745c51'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:20.572971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1215/2419] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:30:20 2022] DELETE /identity/v3/users/9fbf8b65ad1740e485d75c572e745c51 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:20.902059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:20.925845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a36ea5-6384-4a07-bfa9-aad5638a666e service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:21.035060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:21.035767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:21.036051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:21.036327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] PATH_INFO: `/v3/projects/1ffff557177647a1b2d7dfbae3e611e3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:21.038301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ffff557177647a1b2d7dfbae3e611e3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:21.040750 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:21.117311 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ffff557177647a1b2d7dfbae3e611e3', 'request_id': 'req-6a4a9904-0bba-4513-be41-198a2f654c80'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:21.130396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ffff557177647a1b2d7dfbae3e611e3', 'request_id': 'req-6a4a9904-0bba-4513-be41-198a2f654c80'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:21.143308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ffff557177647a1b2d7dfbae3e611e3', 'request_id': 'req-6a4a9904-0bba-4513-be41-198a2f654c80'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:21.166338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] The token cache is being invalidate because project 1ffff557177647a1b2d7dfbae3e611e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:30:21.166697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:21.167813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6a4a9904-0bba-4513-be41-198a2f654c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:30:21.170274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1205/2420] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:30:20 2022] DELETE /identity/v3/projects/1ffff557177647a1b2d7dfbae3e611e3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:30:30.563595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:31.160315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:33.396330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:33.400798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:33.615082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41cee3-535c-4970-bf8b-f2f88b1ca93a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:33.713407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:33.714725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:33.714970 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:33.715341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:33.720146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:33.743767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:33.745968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572cf3c-b817-4504-8905-e33374daf9d2 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:33.763608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1216/2421] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:35.202922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.203518 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.203654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.205895 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1206/2422] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:30:35.219987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3cea1-d634-4f5f-a407-f5a01cbc82c2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.222180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3cea1-d634-4f5f-a407-f5a01cbc82c2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.223673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3cea1-d634-4f5f-a407-f5a01cbc82c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.333008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-f9e3cea1-d634-4f5f-a407-f5a01cbc82c2 None None] MFA Rules not processed for user `ee0b9bc7e5fa4b0d9f67ea235dae32a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:35.336077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f9e3cea1-d634-4f5f-a407-f5a01cbc82c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:35.463971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1217/2423] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:30:35.489533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:35.493866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:35.526374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74aabd-c40e-41f2-ab2f-bf7e32ecb9dd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:35.533914 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:35.535247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.535941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.536548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.554154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:35.560673 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b5f32-4aa8-4a07-91db-19492b547e19 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:35.580336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1207/2424] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:35.761731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c63-d585-4e74-8cf1-396f164fb4d1 None None] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.762212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c63-d585-4e74-8cf1-396f164fb4d1 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.762666 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8c63-d585-4e74-8cf1-396f164fb4d1 None None] PATH_INFO: `/` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.765300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1218/2425] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:30:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:30:35.773665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79900-6aac-4890-b57d-1db111591feb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.774082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79900-6aac-4890-b57d-1db111591feb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.774667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a79900-6aac-4890-b57d-1db111591feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.813768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-20a79900-6aac-4890-b57d-1db111591feb None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:35.816147 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20a79900-6aac-4890-b57d-1db111591feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:35.834809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1208/2426] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:30:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:35.852995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8c63-d585-4e74-8cf1-396f164fb4d1 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:35.871987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8c63-d585-4e74-8cf1-396f164fb4d1 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:35.877136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:35.877857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:35.878246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:35.878619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:35.893491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:35.895502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:35.908446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:35.917702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1219/2427] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:30:45.803836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=9 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:30:57.551306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:57.553088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:57.553088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:57.578845 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] MFA Rules not processed for user `4cf5be327ff749ee901f5fb33ab9f6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:30:57.580653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:57.701470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1209/2428] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:30:58.178230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:30:58.180231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:58.197039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330701b9-4dfe-4580-9245-9768eeaa3bf5 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:30:58.201738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:30:58.202375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:30:58.202656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:30:58.202928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:30:58.204791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:30:58.220957 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:30:58.223728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:30:58.243342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1220/2429] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:30:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:07.688375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=25 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:08.235005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:09.959619 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:09.975893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9abee-4cbf-4516-8d91-c5c3ba219a6e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:09.979721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:09.980346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:09.980623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:09.980908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:09.982710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:10.069596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:10.071848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:10.083005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1210/2430] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:14.172752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:14.174261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:14.269780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:14.272599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:14.285709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9b319-fbdc-4f47-a700-2fe6fc64ac28 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:14.291589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:14.292244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:14.292713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:14.293167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] PATH_INFO: `/v3/users/464032d99d274cb3a9fe028634b47935` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:14.294379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=464032d99d274cb3a9fe028634b47935)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:14.296362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:14.304854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13397-ddf3-46b7-8545-df9d4fb0f80f service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:14.311386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:14.312035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:14.312352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:14.312580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:14.314518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:14.328416 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:14.330169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:14.342094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1221/2431] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:31:14.373784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '464032d99d274cb3a9fe028634b47935'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.392301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '464032d99d274cb3a9fe028634b47935'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.400342 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '464032d99d274cb3a9fe028634b47935'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.401437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '464032d99d274cb3a9fe028634b47935'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.402063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6df45a18-6548-4ce8-a003-a93bac188d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '464032d99d274cb3a9fe028634b47935'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.417781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1211/2432] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:31:14 2022] DELETE /identity/v3/users/464032d99d274cb3a9fe028634b47935 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:14.617296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:14.634224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7394e-faab-4092-ab15-8884fbe2a206 service placement] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:14.703460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:14.704105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:14.704389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:14.704659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] PATH_INFO: `/v3/projects/5d32d8a616e94a0f80aa4ca28b0805f7` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:14.705844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d32d8a616e94a0f80aa4ca28b0805f7)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:14.707754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:14.779774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d32d8a616e94a0f80aa4ca28b0805f7', 'request_id': 'req-d6cc7051-a15c-4d40-80db-5a02e91c80cf'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.789892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d32d8a616e94a0f80aa4ca28b0805f7', 'request_id': 'req-d6cc7051-a15c-4d40-80db-5a02e91c80cf'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.797937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d32d8a616e94a0f80aa4ca28b0805f7', 'request_id': 'req-d6cc7051-a15c-4d40-80db-5a02e91c80cf'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.817057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] The token cache is being invalidate because project 5d32d8a616e94a0f80aa4ca28b0805f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:31:14.817352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.818594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-d6cc7051-a15c-4d40-80db-5a02e91c80cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:14.820145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1222/2433] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:31:14 2022] DELETE /identity/v3/projects/5d32d8a616e94a0f80aa4ca28b0805f7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:14.825515 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:14.825800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:14.826073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:14.868971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:14.870122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:14.934757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:14.947087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1212/2434] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:14.955975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:14.956400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:14.956751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:14.989344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:14.990737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:15.003577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1223/2435] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:15.011063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.024677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346e75-238d-4da0-87cf-335a2e270ed0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.031045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.031749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.032034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.032336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.033137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:31:15.033379 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.035023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.050269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1213/2436] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:31:15.057105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.073520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49550a49-235d-4bea-9775-c47327d50f30 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.078624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.079242 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.079531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.079807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.080438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.082423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.096208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:15.118397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1224/2437] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:31:15 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:15.124891 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.142054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa2f6-e051-4bf1-9872-3258d565e078 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.227120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.227752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.228028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.228316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.228991 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.231642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.261080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1214/2438] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:31:15 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:15.268035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.281614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db390e6-3c38-4611-b5b3-3c2834f7ce70 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.292336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.293451 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.293928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.294419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.295669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.298845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.321385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1225/2439] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:31:15.326110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.338569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40411733-48ee-479b-8f22-735bc51d6323 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.344478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.345551 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.346054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.346404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.349314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.351092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64140ea-aef0-42a3-84ff-371638179dd6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.372560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1215/2440] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:31:15.379249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.399601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095924-4580-4533-9c38-b929fc04dde8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.418636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.420124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.420124 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.420430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] PATH_INFO: `/v3/projects/fcb03ed070a040f1948b7e5bd35d6eed/users/f6c8cdacfac84219b3658a5df295e49e/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.451562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb03ed070a040f1948b7e5bd35d6eed, user_id=f6c8cdacfac84219b3658a5df295e49e, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.454606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.490230 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1226/2441] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:15 2022] PUT /identity/v3/projects/fcb03ed070a040f1948b7e5bd35d6eed/users/f6c8cdacfac84219b3658a5df295e49e/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:15.493847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.501848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.505013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.551464 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] MFA Rules not processed for user `f6c8cdacfac84219b3658a5df295e49e`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:15.554710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:15.682226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1216/2442] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:15.687668 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.805687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952baed-d354-4b26-a59f-099f2924fdc8 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.811040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.811687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.811956 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.812229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.813025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.815453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:15.859101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1227/2443] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:31:15 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:31:15.864887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:15.879748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772809f7-a5ba-4c6c-a58a-2ded3689097b None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:15.956305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:15.969076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:15.969675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:15.969959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:15.970234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:15.971011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:15.975731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.005032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1217/2444] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:31:15 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:16.010129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.029322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d7a70-1446-4511-ab0e-623adeb777a0 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.039833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.040483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.040766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.041118 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.041809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.044149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.061504 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1228/2445] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:31:16.069142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.082818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a170808-5548-4937-a4ff-aab38bddae87 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.097852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.099250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.099625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.099965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] PATH_INFO: `/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f/users/de97990dd0b24bdcb9c83d7d135cb48b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.122749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2ea6d01440a6aaa35b56490ab05f, user_id=de97990dd0b24bdcb9c83d7d135cb48b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.129457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.156831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1218/2446] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:16 2022] PUT /identity/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f/users/de97990dd0b24bdcb9c83d7d135cb48b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:16.163020 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.177801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11079b4-dd0e-4e76-8073-96efe9d9d52c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.275481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.276683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.277304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.277768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.278936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.281526 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55bb9-aebd-42d3-80df-2867866ddf33 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.297437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1229/2447] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:31:16.303109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.320646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650ae3b-f27c-4d58-b564-2cf91a0e98c6 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.327390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.328158 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.328462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.328779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] PATH_INFO: `/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f/users/de97990dd0b24bdcb9c83d7d135cb48b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.331172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ce2ea6d01440a6aaa35b56490ab05f, user_id=de97990dd0b24bdcb9c83d7d135cb48b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.334514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.346955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1219/2448] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:16 2022] PUT /identity/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f/users/de97990dd0b24bdcb9c83d7d135cb48b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:16.360299 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.360572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.360876 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.402599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] MFA Rules not processed for user `de97990dd0b24bdcb9c83d7d135cb48b`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:16.404977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:16.430455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:16.543646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1230/2449] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:16.559591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.563190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:16.714659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1ed29-b93a-40ff-bf61-43dd2b89909e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.719186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.719968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.720251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.720519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.742075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.744881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:16.764292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1220/2450] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:16.873584 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:16.887398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b95a1c-34fa-4cca-93c1-524ffcd668e7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:16.891874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:16.892636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:16.893135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:16.893582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:16.986964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:16.990535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02cda9e-c91a-42dd-8f81-686a25d7b3e0 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:17.007227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1231/2451] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:31:26.755629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=54,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:26.998320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=50 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:53.447008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:53.567414 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22004e-138b-41ea-8d8d-9160ccd5f851 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:53.575706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:53.576769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:53.577188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:53.577691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] PATH_INFO: `/v3/users/f6c8cdacfac84219b3658a5df295e49e` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:53.579679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c8cdacfac84219b3658a5df295e49e)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:53.583153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:53.651768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c8cdacfac84219b3658a5df295e49e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:53.671628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c8cdacfac84219b3658a5df295e49e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:53.686288 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c8cdacfac84219b3658a5df295e49e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:53.687517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c8cdacfac84219b3658a5df295e49e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:53.688554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c8cdacfac84219b3658a5df295e49e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:53.708373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1221/2452] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:31:53 2022] DELETE /identity/v3/users/f6c8cdacfac84219b3658a5df295e49e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:53.713880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:53.714707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:53.714870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:53.740683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:53.742027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:53.823380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1232/2453] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:53.841101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:53.843013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:53.959784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299773b4-c25f-4e7a-a670-36b26a5ce0bc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:53.965962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:53.967032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:53.967491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:53.967960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:53.984731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:53.987675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:54.008156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1222/2454] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:54.392150 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:54.394844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:54.416864 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21daabb-5ff2-45d0-8d01-68d4e465603e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:54.424344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:54.425307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:54.425728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:54.426111 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] PATH_INFO: `/v3/projects/fcb03ed070a040f1948b7e5bd35d6eed` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:54.427714 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb03ed070a040f1948b7e5bd35d6eed)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:54.430108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:54.497667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb03ed070a040f1948b7e5bd35d6eed', 'request_id': 'req-f913df7d-c47f-4a50-a0b0-74d066cd4c20'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.507692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb03ed070a040f1948b7e5bd35d6eed', 'request_id': 'req-f913df7d-c47f-4a50-a0b0-74d066cd4c20'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.515372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb03ed070a040f1948b7e5bd35d6eed', 'request_id': 'req-f913df7d-c47f-4a50-a0b0-74d066cd4c20'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.529256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] The token cache is being invalidate because project fcb03ed070a040f1948b7e5bd35d6eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:31:54.529724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.530788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.533293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1233/2455] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:31:54 2022] DELETE /identity/v3/projects/fcb03ed070a040f1948b7e5bd35d6eed => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:54.537971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:54.554254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4740b3-f711-4e83-b8a5-e34f2d9eaf13 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:54.580202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:54.636206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:54.636964 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:54.637352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:54.637671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] PATH_INFO: `/v3/users/de97990dd0b24bdcb9c83d7d135cb48b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:54.638995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de97990dd0b24bdcb9c83d7d135cb48b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:54.641231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:54.725421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de97990dd0b24bdcb9c83d7d135cb48b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.748847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de97990dd0b24bdcb9c83d7d135cb48b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.763372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de97990dd0b24bdcb9c83d7d135cb48b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.764636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de97990dd0b24bdcb9c83d7d135cb48b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.765737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f241d475-b831-473d-a532-9984ec91d386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de97990dd0b24bdcb9c83d7d135cb48b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:54.789709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1223/2456] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:31:54 2022] DELETE /identity/v3/users/de97990dd0b24bdcb9c83d7d135cb48b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:55.197631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.199549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:55.218968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913df7d-c47f-4a50-a0b0-74d066cd4c20 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.339767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.340381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.340662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.340985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] PATH_INFO: `/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.344800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ce2ea6d01440a6aaa35b56490ab05f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.346775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.384671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:55.406184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ce2ea6d01440a6aaa35b56490ab05f', 'request_id': 'req-a4dd5967-3803-4379-94e3-82318e048f2a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:55.416761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ce2ea6d01440a6aaa35b56490ab05f', 'request_id': 'req-a4dd5967-3803-4379-94e3-82318e048f2a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:55.424285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ce2ea6d01440a6aaa35b56490ab05f', 'request_id': 'req-a4dd5967-3803-4379-94e3-82318e048f2a'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:55.436641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] The token cache is being invalidate because project 66ce2ea6d01440a6aaa35b56490ab05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:31:55.436985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:55.437648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a4dd5967-3803-4379-94e3-82318e048f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:31:55.439195 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1234/2457] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:31:55 2022] DELETE /identity/v3/projects/66ce2ea6d01440a6aaa35b56490ab05f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:55.445192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.445724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.446046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.503736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:55.505186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:55.570852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1224/2458] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:31:55.579878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.580158 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.580435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.608771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:55.609936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:55.619063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1235/2459] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:55.623574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.635634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7b704-938f-440c-9e45-0eaa20b8ef1d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.640421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.641285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.641562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.641831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.642495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:31:55.642798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.645024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.659119 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1225/2460] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:31:55.665636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.676560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c9ef-a94f-45db-a024-1b4926541204 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.681525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.682137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.682414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.682691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.683351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.685339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.745016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1236/2461] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:31:55 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:55.746661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.753592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:55.758291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a03d9-4136-4b78-be36-13a63419c7d8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.844656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.845421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.845747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.846065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.846837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.850489 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.889785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1226/2462] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:31:55 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:31:55.895946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.917226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f8fc-7659-47c7-ab3a-3f4efc90f5ae admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.926570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.927959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.928376 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.928937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.930624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.933823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.952019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1237/2463] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:31:55.961105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:55.971902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf0d9c-bfea-48b7-ba43-1cc9ca8fa136 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:55.979128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:55.980695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:55.981138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:55.981497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:55.982254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:55.984469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab38f3-b62a-4e5a-889a-5fbfa531506e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:55.998296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1227/2464] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:31:56.003388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.015587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1f2d7-f97f-462a-8a26-925a2bc7c214 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.022522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.023212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.023517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.023808 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] PATH_INFO: `/v3/projects/2d3fe98799954fd1bcd7d98835d47e8a/users/405bc95ce3cc4ebe803c1f7de6731484/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.042042 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3fe98799954fd1bcd7d98835d47e8a, user_id=405bc95ce3cc4ebe803c1f7de6731484, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.044827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.064638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1238/2465] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:56 2022] PUT /identity/v3/projects/2d3fe98799954fd1bcd7d98835d47e8a/users/405bc95ce3cc4ebe803c1f7de6731484/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:56.078015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.078448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.078841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.114931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] MFA Rules not processed for user `405bc95ce3cc4ebe803c1f7de6731484`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:56.116593 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:56.202500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1228/2466] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:56.208716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.303886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe39b6d-2c19-4b4d-be9e-04a2bceecacc admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.313386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.314024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.314331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.314610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.315282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.317419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.360842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1239/2467] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:31:56 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:56.368335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.386655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e633-bd13-4d1e-bce6-4e2d072a42bb None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.514292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.515373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.515871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.516370 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.517612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.522437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.562966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1229/2468] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:31:56 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:31:56.569762 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.590009 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e88b89-b044-4917-bc10-fd3a41ec1727 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.599677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.600739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.601266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.602006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.602897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.606148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.622282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1240/2469] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:31:56.627679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.636486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:56.646939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9bf80-b20a-4ce2-8281-01ef64057e0d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.652590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.653317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.653604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.653880 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] PATH_INFO: `/v3/projects/bf9c47a1468844e6a72a445c53d290fc/users/2b373ff2391c43bf96084d1621206138/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.672521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9c47a1468844e6a72a445c53d290fc, user_id=2b373ff2391c43bf96084d1621206138, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.675371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.690477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1230/2470] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:56 2022] PUT /identity/v3/projects/bf9c47a1468844e6a72a445c53d290fc/users/2b373ff2391c43bf96084d1621206138/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:31:56.695341 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.708016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181603-2c14-4af4-bc70-7396ef6af290 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.730472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:31:56.775159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.775760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.776098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.776371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.777078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.778711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cd760-6d19-4427-b540-e84a5c9c9cf6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.790542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1241/2471] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:31:56.794908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:56.812039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63a88c-950d-4bf3-8605-27b796f5a768 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:56.819019 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:56.819720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.820005 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.820284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] PATH_INFO: `/v3/projects/bf9c47a1468844e6a72a445c53d290fc/users/2b373ff2391c43bf96084d1621206138/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.822710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9c47a1468844e6a72a445c53d290fc, user_id=2b373ff2391c43bf96084d1621206138, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:56.825465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:56.838214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1231/2472] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:31:56 2022] PUT /identity/v3/projects/bf9c47a1468844e6a72a445c53d290fc/users/2b373ff2391c43bf96084d1621206138/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:31:56.849283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:56.849574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:56.849886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:56.883706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] MFA Rules not processed for user `2b373ff2391c43bf96084d1621206138`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:31:56.885048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:56.994292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1242/2473] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:31:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:31:57.007009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:57.009782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:57.082533 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4606096-5897-47ff-8f8f-c5820088d8cd admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:57.086412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:57.087060 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:57.087402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:57.087751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:57.099560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:57.101074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:57.112155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1232/2474] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:31:57.161989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:31:57.163514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:31:57.178156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cabc1e-3e60-4eef-b598-ba1118214350 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:31:57.182247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:31:57.182943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:31:57.183222 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:31:57.183499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:31:57.265683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:31:57.267157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec1110-0a2b-481f-ad85-b6b4231e46ce service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:31:57.278601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1243/2475] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:31:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:01.369932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:01.451360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbeb25-0133-4968-881f-fc7022684064 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:01.456923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:01.457796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:01.458080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:01.458351 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] PATH_INFO: `/v3/users/405bc95ce3cc4ebe803c1f7de6731484` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:01.459653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405bc95ce3cc4ebe803c1f7de6731484)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:01.461691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:01.530747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405bc95ce3cc4ebe803c1f7de6731484'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:01.552405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405bc95ce3cc4ebe803c1f7de6731484'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:01.558499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:01.562234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405bc95ce3cc4ebe803c1f7de6731484'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:01.563415 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405bc95ce3cc4ebe803c1f7de6731484'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:01.565109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405bc95ce3cc4ebe803c1f7de6731484'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:01.588609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1233/2476] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:01 2022] DELETE /identity/v3/users/405bc95ce3cc4ebe803c1f7de6731484 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:01.596003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:01.596730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:01.597701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:01.631634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:01.633869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:01.698624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:01.729061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1244/2477] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:01.745109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:01.746780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:01.842826 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0ed9-75cc-4578-b6a8-bfc5976619e1 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:01.847452 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:01.848604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:01.848604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:01.848929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:01.867283 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:01.868244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:01.882754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1234/2478] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:02.339907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:02.341538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:02.358427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9420f7a-6fb0-4bf0-b2ba-00b1d00b520e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:02.365760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:02.366887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:02.367377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:02.367869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] PATH_INFO: `/v3/projects/2d3fe98799954fd1bcd7d98835d47e8a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:02.370170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3fe98799954fd1bcd7d98835d47e8a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:02.374670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:02.466631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3fe98799954fd1bcd7d98835d47e8a', 'request_id': 'req-33310255-0b57-44b2-9d9c-59f62871baaa'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.478192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3fe98799954fd1bcd7d98835d47e8a', 'request_id': 'req-33310255-0b57-44b2-9d9c-59f62871baaa'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.486370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3fe98799954fd1bcd7d98835d47e8a', 'request_id': 'req-33310255-0b57-44b2-9d9c-59f62871baaa'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.501716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] The token cache is being invalidate because project 2d3fe98799954fd1bcd7d98835d47e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:02.501716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.502253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.503873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1245/2479] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:02 2022] DELETE /identity/v3/projects/2d3fe98799954fd1bcd7d98835d47e8a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:02.508981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:02.526807 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c377bdc-036f-4f55-b804-131eca3fe32f service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:02.630623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:02.631202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:02.631481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:02.631756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] PATH_INFO: `/v3/users/2b373ff2391c43bf96084d1621206138` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:02.633000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b373ff2391c43bf96084d1621206138)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:02.635088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:02.710872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b373ff2391c43bf96084d1621206138'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.738453 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b373ff2391c43bf96084d1621206138'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.756039 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b373ff2391c43bf96084d1621206138'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.756900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b373ff2391c43bf96084d1621206138'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.757546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-a3696f8d-882c-435f-8785-ac3bf56977e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b373ff2391c43bf96084d1621206138'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:02.781936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1235/2480] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:02 2022] DELETE /identity/v3/users/2b373ff2391c43bf96084d1621206138 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:03.266400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.269692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:03.291250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33310255-0b57-44b2-9d9c-59f62871baaa admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.375157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.375946 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.376284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.376691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] PATH_INFO: `/v3/projects/bf9c47a1468844e6a72a445c53d290fc` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.379127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9c47a1468844e6a72a445c53d290fc)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.381476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:03.441037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9c47a1468844e6a72a445c53d290fc', 'request_id': 'req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:03.452516 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9c47a1468844e6a72a445c53d290fc', 'request_id': 'req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:03.462201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9c47a1468844e6a72a445c53d290fc', 'request_id': 'req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:03.473655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:03.483490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] The token cache is being invalidate because project bf9c47a1468844e6a72a445c53d290fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:03.484847 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:03.486647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9726a582-5d5b-4ae8-a6d6-a7be4fdda16f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:03.491434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1246/2481] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:03 2022] DELETE /identity/v3/projects/bf9c47a1468844e6a72a445c53d290fc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:03.499583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.499921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.500328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.535219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:03.536676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:03.541562 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:03.631787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1236/2482] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:03.642852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.643186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.643531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.671554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:03.673797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:03.688892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1247/2483] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:03.694425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.705418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b53a2-d394-41e4-bdb4-49e399fd9acd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.711162 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.711736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.712021 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.712292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.712992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:32:03.713298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.714954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:03.729339 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1237/2484] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:32:03.735415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.748601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682f6cf-6769-45ee-860d-541f68184d19 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.757896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.758981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.759482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.759976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.761192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.765202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:03.832269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1248/2485] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:03 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:03.838769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.856573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a3d7-a3fa-4844-98c0-d455253f13e9 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.936146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.936858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.937303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.937708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.938491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.941354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:03.969129 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1238/2486] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:03 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:03.974497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:03.986247 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a9464-c2cf-45c3-abbe-f974611ac4f3 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:03.994181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:03.994843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:03.995127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:03.997556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:03.997556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:03.998610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.019579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1249/2487] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:32:04.030190 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.051314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfadf82-aaa2-4f6b-9472-c3b2f68d21cf admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.060255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.061387 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.061892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.062386 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.063338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.067096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c2a04-4350-4a9b-b0f7-8233a46522f1 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.087541 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1239/2488] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:04.093078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.111258 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a3ce5-3ec8-49c9-a77a-469d31336fb2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.119325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.120089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.120572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.121114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] PATH_INFO: `/v3/projects/011d12f459b246e1b983ad2261d0e9ad/users/0f28f16a84d04cf592972955795852a4/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.150669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=011d12f459b246e1b983ad2261d0e9ad, user_id=0f28f16a84d04cf592972955795852a4, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.156460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.182138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1250/2489] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:04 2022] PUT /identity/v3/projects/011d12f459b246e1b983ad2261d0e9ad/users/0f28f16a84d04cf592972955795852a4/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:04.202649 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.203066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.203350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.252080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] MFA Rules not processed for user `0f28f16a84d04cf592972955795852a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:04.254101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:04.347077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1240/2490] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:04.352906 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.469741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd4390-21c6-46dc-bb17-0484ad07ae9c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.477126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.478132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.478649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.479142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.480298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.482728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.526013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1251/2491] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:04 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:04.530580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.538945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:04.547713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8295e-9fae-4f30-a289-0a4964d36d5a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.623236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.623925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.624310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.624679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.625498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.627817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.659754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1241/2492] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:04 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:32:04.664942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.676997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdc4f8-a403-470e-88f1-6c979457d161 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.682268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.682914 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.683192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.683471 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.684142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.685851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.699764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1252/2493] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:04.706305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.734637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a0fb1-bfeb-4ba7-ad27-8ad0d55d7c13 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.741117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.741877 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.742287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.742613 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] PATH_INFO: `/v3/projects/8d4998aa577a43deb026e37d5ee22150/users/385a0e5488ee462482d59dce82f4f69f/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.764856 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4998aa577a43deb026e37d5ee22150, user_id=385a0e5488ee462482d59dce82f4f69f, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.766756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.786069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1242/2494] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:04 2022] PUT /identity/v3/projects/8d4998aa577a43deb026e37d5ee22150/users/385a0e5488ee462482d59dce82f4f69f/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:04.790796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.803052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44512fc5-4364-49e4-8057-d4c4f4432ea0 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.877022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.877725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.878549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.878818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.879699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.881375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf034b9-8a8d-4cc1-815f-e1bb0f144b21 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.892248 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1253/2495] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:04.897689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:04.910993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9ceb-61f7-416f-b2db-b4c53711ce10 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:04.916198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:04.917003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.917280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.917554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] PATH_INFO: `/v3/projects/8d4998aa577a43deb026e37d5ee22150/users/385a0e5488ee462482d59dce82f4f69f/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.919585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4998aa577a43deb026e37d5ee22150, user_id=385a0e5488ee462482d59dce82f4f69f, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:04.922364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:04.943240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1243/2496] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:04 2022] PUT /identity/v3/projects/8d4998aa577a43deb026e37d5ee22150/users/385a0e5488ee462482d59dce82f4f69f/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:04.954317 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:04.954602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:04.954901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:04.964167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:04.991052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] MFA Rules not processed for user `385a0e5488ee462482d59dce82f4f69f`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:04.994767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:05.080148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1254/2497] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:05.091648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:05.093384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:05.160704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c11ea0-4224-4134-a54f-b846ed22dcb2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:05.164540 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:05.165192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:05.165474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:05.165747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:05.176853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:05.178327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:05.191216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1244/2498] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:05.240552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:05.242015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:05.255226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebcd53-cffd-47aa-912f-c061a283a522 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:05.259134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:05.259749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:05.260022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:05.260293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:05.321790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:05.323224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d28b57-5ff3-4b93-ba65-b84bffae91f5 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:05.333216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1255/2499] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:05 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:08.982011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:09.063291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6236d9-9f39-467e-9a34-05bfc39bf54e service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:09.072716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:09.073628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:09.073999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:09.074366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] PATH_INFO: `/v3/users/0f28f16a84d04cf592972955795852a4` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:09.075777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f28f16a84d04cf592972955795852a4)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:09.077916 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:09.079917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:09.162676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f28f16a84d04cf592972955795852a4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.184687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f28f16a84d04cf592972955795852a4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.198251 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f28f16a84d04cf592972955795852a4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.199636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f28f16a84d04cf592972955795852a4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.200704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f28f16a84d04cf592972955795852a4'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.221168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1245/2500] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:08 2022] DELETE /identity/v3/users/0f28f16a84d04cf592972955795852a4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:09.228545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:09.230749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:09.231199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:09.257537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:09.259713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:09.370414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1256/2501] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:09.384047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:09.386231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:09.473972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd4b74-ee99-415b-8182-492c2cb171cd admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:09.478010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:09.478855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:09.478855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:09.479299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:09.490219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:09.491717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:09.506570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1246/2502] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:09.886804 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:09.888592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:09.909616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2324-75e4-4525-975b-778aecdc9652 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:09.916487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:09.917476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:09.917903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:09.918239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] PATH_INFO: `/v3/projects/011d12f459b246e1b983ad2261d0e9ad` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:09.919811 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011d12f459b246e1b983ad2261d0e9ad)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:09.922128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:09.960069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:09.990172 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011d12f459b246e1b983ad2261d0e9ad', 'request_id': 'req-2f83d1f0-cb47-49d9-96b6-0246f2147a96'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:09.998579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011d12f459b246e1b983ad2261d0e9ad', 'request_id': 'req-2f83d1f0-cb47-49d9-96b6-0246f2147a96'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.006838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011d12f459b246e1b983ad2261d0e9ad', 'request_id': 'req-2f83d1f0-cb47-49d9-96b6-0246f2147a96'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.025581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] The token cache is being invalidate because project 011d12f459b246e1b983ad2261d0e9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:10.025907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.026684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.028243 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1257/2503] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:09 2022] DELETE /identity/v3/projects/011d12f459b246e1b983ad2261d0e9ad => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:10.032721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:10.044727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e317-5fa2-43d2-9d75-7ae2527c4acd service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:10.118885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:10.119538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.119815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.120085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] PATH_INFO: `/v3/users/385a0e5488ee462482d59dce82f4f69f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.122168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385a0e5488ee462482d59dce82f4f69f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:10.123429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:10.156665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:10.197056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385a0e5488ee462482d59dce82f4f69f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.213978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385a0e5488ee462482d59dce82f4f69f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.222307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385a0e5488ee462482d59dce82f4f69f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.223070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385a0e5488ee462482d59dce82f4f69f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.223715 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-c8774234-8e17-4fee-b7e9-11eed67eb794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385a0e5488ee462482d59dce82f4f69f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.239253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1247/2504] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:10 2022] DELETE /identity/v3/users/385a0e5488ee462482d59dce82f4f69f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:10.624449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:10.626309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:10.645176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d1f0-cb47-49d9-96b6-0246f2147a96 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:10.717609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:10.718161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.718442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.718713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] PATH_INFO: `/v3/projects/8d4998aa577a43deb026e37d5ee22150` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.719903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4998aa577a43deb026e37d5ee22150)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:10.723268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:10.792060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4998aa577a43deb026e37d5ee22150', 'request_id': 'req-cbda9869-5ca6-4504-ad48-c2afb5667f8f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.803557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4998aa577a43deb026e37d5ee22150', 'request_id': 'req-cbda9869-5ca6-4504-ad48-c2afb5667f8f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.811403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4998aa577a43deb026e37d5ee22150', 'request_id': 'req-cbda9869-5ca6-4504-ad48-c2afb5667f8f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.824562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] The token cache is being invalidate because project 8d4998aa577a43deb026e37d5ee22150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:10.825209 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.825562 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbda9869-5ca6-4504-ad48-c2afb5667f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:10.827127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1258/2505] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:10 2022] DELETE /identity/v3/projects/8d4998aa577a43deb026e37d5ee22150 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:10.832923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.833213 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.833488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.860241 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:10.861721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:10.949743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1248/2506] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:10.960593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:10.961057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:10.961403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:10.985866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:10.987617 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:10.999535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1259/2507] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:11.004597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.016980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92f1b-80b4-493a-95d7-bac1064f7d53 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.025073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.025754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.026150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.026344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.026984 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:32:11.027294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.028972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.048928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1249/2508] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:32:11.054981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.073185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6758f63-0880-4876-80b2-f6fa6b702d19 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.081788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.082780 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.083270 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.083750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.084981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.088897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.136935 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1260/2509] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:11 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:11.142784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.163326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e3ca3-d672-4861-9957-a33953c7b3a7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.262542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.263553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.263938 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.264308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.265209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.267450 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.294697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1250/2510] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:11 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:11.299767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.312145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40dca1-fd98-42b7-9bb1-64c536108414 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.321835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.322905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.323486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.323827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.324639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.327932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.350537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1261/2511] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:11.355141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.369954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff93a2-ef11-43d0-96d9-7beab014a8a7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.391367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.391367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.391367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.391367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.391738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.391738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5326b57-c03f-429e-8112-07a9098d3b1b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.416110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1251/2512] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:11.424234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.431093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:11.437627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c007b-a24d-493d-8d11-52f71fb7b3da admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.446621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.446827 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.447352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.448180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] PATH_INFO: `/v3/projects/dfee5523a758401badb568c560e8ccf4/users/a8257a01f7904ed0a1f47ac966b4b8e7/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.481331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfee5523a758401badb568c560e8ccf4, user_id=a8257a01f7904ed0a1f47ac966b4b8e7, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.487880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.517225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1262/2513] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:11 2022] PUT /identity/v3/projects/dfee5523a758401badb568c560e8ccf4/users/a8257a01f7904ed0a1f47ac966b4b8e7/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:11.538874 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.539309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.539917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.566295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:11.588467 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] MFA Rules not processed for user `a8257a01f7904ed0a1f47ac966b4b8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:11.589746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:11.682491 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1252/2514] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:11.687767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.797915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825eeff-2455-4e52-b480-4eb18e1d29ae admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.806148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.807280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.807605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.808054 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.809641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.813589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.858525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1263/2515] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:11 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:11.865627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:11.887731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61421a-20b7-4e82-9880-43c4c07cbd47 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:11.959044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:11.959672 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:11.959942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:11.960246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:11.960878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:11.962836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:11.986762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1253/2516] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:11 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:32:11.991872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.003830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6426fdd1-8e85-41e1-9902-c9e439bd0b09 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.008563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.009221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.009494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.009764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.010403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.012008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.027707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1264/2517] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:12.034628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.053325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8cd0c-d340-41bf-9e02-5c4d3b4d33f4 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.061293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.062460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.062973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.063443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] PATH_INFO: `/v3/projects/c71919cf43c74894b688456598df0367/users/40ddd0c87c344d6e8aad615a19d8d61d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.094565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71919cf43c74894b688456598df0367, user_id=40ddd0c87c344d6e8aad615a19d8d61d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.098323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.116778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1254/2518] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:12 2022] PUT /identity/v3/projects/c71919cf43c74894b688456598df0367/users/40ddd0c87c344d6e8aad615a19d8d61d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:12.121739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.134338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13569ffb-6359-4fc7-8e6c-66fe4d16d439 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.202106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.202782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.203061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.203332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.203979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.205625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa468a7-0fe6-4a81-ab3c-b22160c46cd6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.217373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1265/2519] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:12.222507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.233463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d665d9b-6e55-4345-b62e-9ed226634fde admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.240192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.241061 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.241341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.241616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] PATH_INFO: `/v3/projects/c71919cf43c74894b688456598df0367/users/40ddd0c87c344d6e8aad615a19d8d61d/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.243657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71919cf43c74894b688456598df0367, user_id=40ddd0c87c344d6e8aad615a19d8d61d, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.246460 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.258919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1255/2520] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:12 2022] PUT /identity/v3/projects/c71919cf43c74894b688456598df0367/users/40ddd0c87c344d6e8aad615a19d8d61d/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:12.270963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.272439 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.273117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.317322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] MFA Rules not processed for user `40ddd0c87c344d6e8aad615a19d8d61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:12.318525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:12.385155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:12.432351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1266/2521] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:12.450961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.453520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:12.546674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:12.555996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07d52d-9362-4625-bcf1-2040390ad5ea admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.563609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.564588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.565107 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.566181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.583718 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.586445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.604427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1256/2522] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:32:12.724895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:12.737595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c8e2a-6c81-49c4-88be-0e312ecb50c4 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:12.742791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:12.743533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:12.743896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:12.744333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:12.815104 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:12.816924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d692a4e-62ab-4234-935f-0ac9984a1e60 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:12.827685 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1267/2523] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:15.516565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:15.585851 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e5d4d-a623-4b04-a227-5c042cabfb70 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:15.590852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:15.591731 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:15.591898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:15.592050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] PATH_INFO: `/v3/users/a8257a01f7904ed0a1f47ac966b4b8e7` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:15.593314 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8257a01f7904ed0a1f47ac966b4b8e7)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:15.595364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:15.675924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8257a01f7904ed0a1f47ac966b4b8e7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:15.694632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8257a01f7904ed0a1f47ac966b4b8e7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:15.713606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8257a01f7904ed0a1f47ac966b4b8e7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:15.714490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8257a01f7904ed0a1f47ac966b4b8e7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:15.715397 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8257a01f7904ed0a1f47ac966b4b8e7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:15.740590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1257/2524] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:15 2022] DELETE /identity/v3/users/a8257a01f7904ed0a1f47ac966b4b8e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:15.745851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508748-5301-47bb-a971-30d9789bd987 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:15.746405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508748-5301-47bb-a971-30d9789bd987 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:15.746687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90508748-5301-47bb-a971-30d9789bd987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:15.772871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-90508748-5301-47bb-a971-30d9789bd987 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:15.774151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-90508748-5301-47bb-a971-30d9789bd987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:15.854916 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1268/2525] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:15.866319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:15.867869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:15.939844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3cf6a-3c41-4f9f-93b2-4b668850bb39 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:15.944254 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:15.945375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:15.945685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:15.945957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:15.956095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:15.958054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:15.969725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1258/2526] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:32:16.363557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90508748-5301-47bb-a971-30d9789bd987 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:16.365320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-90508748-5301-47bb-a971-30d9789bd987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:16.381371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90508748-5301-47bb-a971-30d9789bd987 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:16.390234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:16.391051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:16.391371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:16.391719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] PATH_INFO: `/v3/projects/dfee5523a758401badb568c560e8ccf4` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:16.393448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfee5523a758401badb568c560e8ccf4)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:16.398586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:16.473481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfee5523a758401badb568c560e8ccf4', 'request_id': 'req-9ca86106-ba54-4ed6-bc6e-3941093c5e54'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.482858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfee5523a758401badb568c560e8ccf4', 'request_id': 'req-9ca86106-ba54-4ed6-bc6e-3941093c5e54'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.490129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfee5523a758401badb568c560e8ccf4', 'request_id': 'req-9ca86106-ba54-4ed6-bc6e-3941093c5e54'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.494999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:16.502289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] The token cache is being invalidate because project dfee5523a758401badb568c560e8ccf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:16.502698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.503662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.506409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1269/2527] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:16 2022] DELETE /identity/v3/projects/dfee5523a758401badb568c560e8ccf4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:16.510815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:16.522620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ee765-5f07-4d6c-bd5f-13bd5bbcebaa service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:16.534263 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:16.593942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:16.594668 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:16.594986 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:16.595327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] PATH_INFO: `/v3/users/40ddd0c87c344d6e8aad615a19d8d61d` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:16.596798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ddd0c87c344d6e8aad615a19d8d61d)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:16.599844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:16.671834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ddd0c87c344d6e8aad615a19d8d61d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.691932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ddd0c87c344d6e8aad615a19d8d61d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.700736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ddd0c87c344d6e8aad615a19d8d61d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.701568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ddd0c87c344d6e8aad615a19d8d61d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.702445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f66cdb8c-b5a6-4b5f-ba71-53dab384be1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ddd0c87c344d6e8aad615a19d8d61d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:16.719157 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1259/2528] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:16 2022] DELETE /identity/v3/users/40ddd0c87c344d6e8aad615a19d8d61d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:17.075024 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.077598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:17.097455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca86106-ba54-4ed6-bc6e-3941093c5e54 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.166833 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.167528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.167806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.168078 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] PATH_INFO: `/v3/projects/c71919cf43c74894b688456598df0367` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.169328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71919cf43c74894b688456598df0367)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.171265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.225752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71919cf43c74894b688456598df0367', 'request_id': 'req-7135e1af-4093-491d-a7aa-6fb8b24cad3d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:17.236125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71919cf43c74894b688456598df0367', 'request_id': 'req-7135e1af-4093-491d-a7aa-6fb8b24cad3d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:17.251000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71919cf43c74894b688456598df0367', 'request_id': 'req-7135e1af-4093-491d-a7aa-6fb8b24cad3d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:17.267250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] The token cache is being invalidate because project c71919cf43c74894b688456598df0367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:17.267694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:17.268507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-7135e1af-4093-491d-a7aa-6fb8b24cad3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:17.270884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1270/2529] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:17 2022] DELETE /identity/v3/projects/c71919cf43c74894b688456598df0367 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:17.278405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.278693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.278966 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.314023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:17.315383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:17.395367 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1260/2530] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:17.403406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.403784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.404060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.434991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:17.437349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:17.457293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1271/2531] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:17.459328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.475389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a1467-963c-410f-ad29-b7f816227d7f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.480632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.481290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.481566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.481872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.482565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:32:17.482869 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.484662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.504009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1261/2532] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:32:17.505843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.516165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e57343-ca16-440b-b410-5bc87e2be56b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.523007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.523773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.524053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.524426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.525238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.527211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.563838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1272/2533] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:17 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:17.570813 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.581606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab4f59-0298-4b7d-a761-f6f5b3fec54c admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.602171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:17.669548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.670166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.670577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.670700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.671352 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.673346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.699833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1262/2534] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:17 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:17.706221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.722417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98c292-c0db-4a34-a12e-6c815470ec95 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.728987 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.729699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.730018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.730302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.731112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.733409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.748622 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1273/2535] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:17.754931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.773052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2068f-285d-4322-ad74-c219954e4490 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.780486 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.781586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.782082 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.782638 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.783608 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.786746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c312bd5-7da4-4044-b98a-d806d59a38c2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.799071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1263/2536] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:17.804198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:17.816114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c914f40-e87d-46c3-80ca-f5208869c72f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:17.823563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:17.824636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.825171 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.825599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] PATH_INFO: `/v3/projects/7d4057f844e34e16b3bcfd2acf550e3b/users/7a514dfc39af4df9a742b2cffb8b4a44/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.853177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4057f844e34e16b3bcfd2acf550e3b, user_id=7a514dfc39af4df9a742b2cffb8b4a44, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:17.858456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:17.877199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1274/2537] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:17 2022] PUT /identity/v3/projects/7d4057f844e34e16b3bcfd2acf550e3b/users/7a514dfc39af4df9a742b2cffb8b4a44/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:17.895875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:17.896355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:17.896743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:17.928178 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] MFA Rules not processed for user `7a514dfc39af4df9a742b2cffb8b4a44`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:17.929428 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:18.013885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1264/2538] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:18.018651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.047337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:18.091408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244416d-fa0c-4d19-9180-82ee21243832 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.099088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.100108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.100636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.101132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.102233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.104542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.138375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1275/2539] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:18 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:18.143130 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.156023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc97605-987e-4391-acce-e925c3ce371e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.245051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.246108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.246564 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.247037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.248373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.252080 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.291128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1265/2540] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:18 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:18.297196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.316706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079bf8f-cd5a-4098-9ac6-9ae1c33235e7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.323795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.324433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.324719 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.325096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.325782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.327444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.352407 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1276/2541] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:18.355300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.368676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401e6a5-e38d-4406-8b64-e0bf47c62c30 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.374163 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.374809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.375090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.375366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.376033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.377709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a4e11-50cd-48f2-8c34-4d87c41c086d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.389946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1266/2542] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:18.395149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.407520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3089f-6e26-4090-88ee-6bb95f37612b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.413254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.414017 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.414293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.414612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] PATH_INFO: `/v3/projects/57e73135cecc41d795b39da746eb0c64/users/35d1856844f44a92b32e9109919b0d59/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.433434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e73135cecc41d795b39da746eb0c64, user_id=35d1856844f44a92b32e9109919b0d59, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.436175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.453527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1277/2543] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:18 2022] PUT /identity/v3/projects/57e73135cecc41d795b39da746eb0c64/users/35d1856844f44a92b32e9109919b0d59/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:18.527780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.528066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.528355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.544699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:18.565028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] MFA Rules not processed for user `35d1856844f44a92b32e9109919b0d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:18.567089 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:18.671990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1267/2544] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:18.677032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.756112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77728e95-1ee2-41cb-ab31-9429714dfc73 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.760796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.761441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.762734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.762734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.762734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.764499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.802531 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1278/2545] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:18 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:18.806930 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.819383 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f3245-103e-4953-bf3b-83f43f7e5e6a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.887660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.888304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.888582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.888946 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.889536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.891502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.921726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1268/2546] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:18 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:32:18.926034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.937345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a04bc1-c472-4829-b648-5b30dc1cdc05 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.943045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.943789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.944162 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.944548 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.945607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:18.947446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:18.960117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1279/2547] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:18.964424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:18.974701 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab2a4e-7cca-4d62-a167-017feae10e85 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:18.979679 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:18.980364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:18.980642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:18.980955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] PATH_INFO: `/v3/projects/bba50f94c49346aea31aa117aa33a55b/users/56bcca4fa2ca42eda793386213a01883/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:18.998382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba50f94c49346aea31aa117aa33a55b, user_id=56bcca4fa2ca42eda793386213a01883, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:19.001189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:19.017977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1269/2548] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:18 2022] PUT /identity/v3/projects/bba50f94c49346aea31aa117aa33a55b/users/56bcca4fa2ca42eda793386213a01883/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:19.023428 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:19.033846 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff0e2-a16d-46b6-a5bb-ab6c5c26af42 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:19.082726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:19.097029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:19.098081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:19.098081 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:19.098255 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:19.098805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:19.100401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4717e8-a9db-46ae-a0c6-8ab974b9c512 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:19.110492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1280/2549] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:19.115115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:19.125560 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf69624-267a-4cc9-b78a-806d5e3eaa1f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:19.131030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:19.131695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:19.131972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:19.132244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] PATH_INFO: `/v3/projects/bba50f94c49346aea31aa117aa33a55b/users/56bcca4fa2ca42eda793386213a01883/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:19.134268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba50f94c49346aea31aa117aa33a55b, user_id=56bcca4fa2ca42eda793386213a01883, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:19.136972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:19.151209 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1270/2550] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:19 2022] PUT /identity/v3/projects/bba50f94c49346aea31aa117aa33a55b/users/56bcca4fa2ca42eda793386213a01883/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:19.168551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:19.168861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:19.169137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:19.200245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] MFA Rules not processed for user `56bcca4fa2ca42eda793386213a01883`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:19.201533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:19.280181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1281/2551] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:19.293931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:19.295861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:19.360268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:19.361908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e18f1-df2a-40dd-858f-576a56239a1a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:19.368279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:19.369047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:19.369542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:19.369887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:19.433074 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:19.434600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:19.450546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1271/2552] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:21.105627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:21.107098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:21.120379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d774070-aef0-45d8-bb1d-da513cfa3f4e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:21.124051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:21.124703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:21.124989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:21.125264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:21.196228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:21.197768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:21.208156 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1282/2553] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:21.930542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:21.940205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a308645-f429-49e0-941d-0f208dee276d service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:21.945683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:21.946300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:21.946577 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:21.946847 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:21.957572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:21.959259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bc148-2eee-49b2-8b29-cd9bb5553ab2 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:21.974513 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1272/2554] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:26.195754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:26.316978 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99813e-8fc2-416d-9936-1696e0a216a3 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:26.323239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:26.324342 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:26.324842 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:26.325368 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] PATH_INFO: `/v3/users/7a514dfc39af4df9a742b2cffb8b4a44` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:26.327816 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a514dfc39af4df9a742b2cffb8b4a44)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:26.332705 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:26.344220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:26.446108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a514dfc39af4df9a742b2cffb8b4a44'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:26.448214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a514dfc39af4df9a742b2cffb8b4a44'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:26.464302 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a514dfc39af4df9a742b2cffb8b4a44'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:26.465560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a514dfc39af4df9a742b2cffb8b4a44'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:26.480515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a514dfc39af4df9a742b2cffb8b4a44'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:26.506301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1283/2555] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:26 2022] DELETE /identity/v3/users/7a514dfc39af4df9a742b2cffb8b4a44 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:26.512318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:26.513255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:26.513255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:26.535840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:26.537591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:26.626683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1273/2556] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:26.645836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:26.647958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:26.771623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dc522-0cdb-4bd5-8354-c9322a9de713 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:26.778229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:26.779306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:26.779751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:26.780173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:26.795671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:26.797245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:26.813184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1284/2557] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:32:27.197036 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:27.198971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:27.224728 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f0b4-a0ff-4cfc-9308-d59cc9c59a9c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:27.234363 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:27.235235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:27.235543 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:27.235817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] PATH_INFO: `/v3/projects/7d4057f844e34e16b3bcfd2acf550e3b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:27.237277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4057f844e34e16b3bcfd2acf550e3b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:27.240696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:27.298694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4057f844e34e16b3bcfd2acf550e3b', 'request_id': 'req-eb8ffc21-5e4f-4101-95d7-4c345771a68e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.307139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4057f844e34e16b3bcfd2acf550e3b', 'request_id': 'req-eb8ffc21-5e4f-4101-95d7-4c345771a68e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.313384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4057f844e34e16b3bcfd2acf550e3b', 'request_id': 'req-eb8ffc21-5e4f-4101-95d7-4c345771a68e'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.329860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] The token cache is being invalidate because project 7d4057f844e34e16b3bcfd2acf550e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:27.332931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.332931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.332931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1274/2558] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:27 2022] DELETE /identity/v3/projects/7d4057f844e34e16b3bcfd2acf550e3b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:27.338602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:27.354178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dd1be-4af6-4c1d-b562-137694c8ab27 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:27.443490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:27.444073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:27.444421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:27.445029 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] PATH_INFO: `/v3/users/35d1856844f44a92b32e9109919b0d59` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:27.446487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d1856844f44a92b32e9109919b0d59)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:27.448787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:27.500913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:27.523091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d1856844f44a92b32e9109919b0d59'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.523884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d1856844f44a92b32e9109919b0d59'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.533519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d1856844f44a92b32e9109919b0d59'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.534254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d1856844f44a92b32e9109919b0d59'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.543053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d1856844f44a92b32e9109919b0d59'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:27.572713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1285/2559] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:27 2022] DELETE /identity/v3/users/35d1856844f44a92b32e9109919b0d59 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:27.924365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:27.926972 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:27.954897 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ffc21-5e4f-4101-95d7-4c345771a68e admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:27.972341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:28.040322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:28.041009 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:28.041329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:28.041552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] PATH_INFO: `/v3/projects/57e73135cecc41d795b39da746eb0c64` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:28.042741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e73135cecc41d795b39da746eb0c64)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:28.044702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:28.118740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e73135cecc41d795b39da746eb0c64', 'request_id': 'req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.128566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e73135cecc41d795b39da746eb0c64', 'request_id': 'req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.139871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e73135cecc41d795b39da746eb0c64', 'request_id': 'req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.157892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] The token cache is being invalidate because project 57e73135cecc41d795b39da746eb0c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:28.158167 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.158839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.160435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1275/2560] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:27 2022] DELETE /identity/v3/projects/57e73135cecc41d795b39da746eb0c64 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:28.164996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:28.166534 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:28.180455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab93295-bff6-4e24-89c6-a95c9c15c365 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:28.250944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:28.251506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:28.251785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:28.252071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] PATH_INFO: `/v3/users/56bcca4fa2ca42eda793386213a01883` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:28.253316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bcca4fa2ca42eda793386213a01883)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:28.255549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:28.316700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bcca4fa2ca42eda793386213a01883'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.318076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bcca4fa2ca42eda793386213a01883'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.328089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bcca4fa2ca42eda793386213a01883'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.328937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bcca4fa2ca42eda793386213a01883'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.338728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1b61a6d2-5fac-40df-89b8-90cd0fd73cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bcca4fa2ca42eda793386213a01883'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.370161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1286/2561] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:28 2022] DELETE /identity/v3/users/56bcca4fa2ca42eda793386213a01883 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:28.763103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:28.765738 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:28.793354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29de7d-fe6c-408f-b7ab-b5f44196bdd2 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:28.895667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:28.896646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:28.897384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:28.897596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] PATH_INFO: `/v3/projects/bba50f94c49346aea31aa117aa33a55b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:28.899000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba50f94c49346aea31aa117aa33a55b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:28.901159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:28.980768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:28.985198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba50f94c49346aea31aa117aa33a55b', 'request_id': 'req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:28.997042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba50f94c49346aea31aa117aa33a55b', 'request_id': 'req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:29.008307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba50f94c49346aea31aa117aa33a55b', 'request_id': 'req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:29.029714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] The token cache is being invalidate because project bba50f94c49346aea31aa117aa33a55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:29.030000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:29.030785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-7c882cc9-0bc6-4b74-8b20-f1e70c3dddd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:29.033076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1276/2562] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:28 2022] DELETE /identity/v3/projects/bba50f94c49346aea31aa117aa33a55b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:32:29.040119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.040658 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.041128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.074859 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:29.076098 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:29.107196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:29.162495 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1287/2563] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:29.170941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.171214 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.171455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.195609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:29.196879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:29.210942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1277/2564] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:29.218853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.238915 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3463-2dd9-488d-8c59-a11a7b01b89d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.244486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.245179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.245427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.245706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.246377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:32:29.246680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.248728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.266459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1288/2565] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:32:29.272226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.289760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92ba9e-0c84-4268-9a4f-5c1f465652f5 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.295976 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.296611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.296926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.297207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.297861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.299806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.339781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1278/2566] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:29.345525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.358871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e02d-f378-420a-bc87-d8f241559707 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.435696 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.436304 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.436903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.437181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.437839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.439813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.471949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1289/2567] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:32:29 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:32:29.477537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.492598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c510f29-d96c-4647-93b3-b508fc819709 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.501299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.502348 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.502844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.503312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.504302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.506417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.520538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1279/2568] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:29.524764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.537420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc679ca-f082-47a0-8606-8516a5840759 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.542683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.543279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.543607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.543887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.544549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.546336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4099171-70f7-4ad6-916a-ab82f864a189 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.559677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1290/2569] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:32:29.564305 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.576055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b060-c6d6-405f-b61d-69dd0858d60d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.581479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.582269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.582468 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.582759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] PATH_INFO: `/v3/projects/fe5f74c754ce458eaaf04e7b38f86ebd/users/2e565ede55ca48bd9ffd9528953933bb/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.602180 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5f74c754ce458eaaf04e7b38f86ebd, user_id=2e565ede55ca48bd9ffd9528953933bb, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.604978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.632780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1280/2570] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:32:29 2022] PUT /identity/v3/projects/fe5f74c754ce458eaaf04e7b38f86ebd/users/2e565ede55ca48bd9ffd9528953933bb/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:29.643361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70049d-22d8-48be-9826-8f02fbd80abe None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.643693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70049d-22d8-48be-9826-8f02fbd80abe None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.646213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70049d-22d8-48be-9826-8f02fbd80abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.681877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-af70049d-22d8-48be-9826-8f02fbd80abe None None] MFA Rules not processed for user `2e565ede55ca48bd9ffd9528953933bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:29.683820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-af70049d-22d8-48be-9826-8f02fbd80abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:29.781825 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1291/2571] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:29.794516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:29.796290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:29.878548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28d4dc-de28-4e49-a34f-4460392a67fe admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:29.883425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:29.884194 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:29.884581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:29.885007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:29.897001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:29.898770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:29.910691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1281/2572] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:31.775280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:31.775879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:31.775879 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:31.814265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:31.815854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:31.826266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:31.911213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1292/2573] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:31.966112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:31.967800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:32.054170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbed279-96d5-4cc1-b40b-bcfae1660569 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:32.060088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:32.060743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:32.061052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:32.061325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:32.071192 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:32.072838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c449842-3587-4344-b0e9-b9f53472b0ad service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:32.089548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1282/2574] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:32:32.723587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:32.821314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954292f7-e4f5-4eef-a1b7-8486d35b9c94 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:32.827279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:32.828282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:32.828565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:32.828877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] PATH_INFO: `/v3/users/2e565ede55ca48bd9ffd9528953933bb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:32.830169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e565ede55ca48bd9ffd9528953933bb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:32.832245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:32.907005 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e565ede55ca48bd9ffd9528953933bb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:32.907823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e565ede55ca48bd9ffd9528953933bb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:32.921282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e565ede55ca48bd9ffd9528953933bb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:32.922382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e565ede55ca48bd9ffd9528953933bb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:32.941249 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e565ede55ca48bd9ffd9528953933bb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:32.973813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1293/2575] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:32:32 2022] DELETE /identity/v3/users/2e565ede55ca48bd9ffd9528953933bb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:32.980015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:32.980919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:32.980919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:32.989824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:33.006774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:33.008787 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:33.108850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1283/2576] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:33.123988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:33.126393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:33.187011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:33.221183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a8c4-7350-4b65-ba73-3b93946e2f73 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:33.223907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:33.224657 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:33.224975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:33.225252 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:33.239680 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:33.241939 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:33.262280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1294/2577] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:33.665529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:33.672539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:33.695393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d93c-e13f-442c-98ab-2894e8cd08ac None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:33.702902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:33.704071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:33.704651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:33.705318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] PATH_INFO: `/v3/projects/fe5f74c754ce458eaaf04e7b38f86ebd` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:33.707767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5f74c754ce458eaaf04e7b38f86ebd)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:33.711475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:33.836678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5f74c754ce458eaaf04e7b38f86ebd', 'request_id': 'req-ae975324-a4ba-46e6-b4ce-5c7fc9981179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:33.848947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5f74c754ce458eaaf04e7b38f86ebd', 'request_id': 'req-ae975324-a4ba-46e6-b4ce-5c7fc9981179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:33.860322 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5f74c754ce458eaaf04e7b38f86ebd', 'request_id': 'req-ae975324-a4ba-46e6-b4ce-5c7fc9981179'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:33.910243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] The token cache is being invalidate because project fe5f74c754ce458eaaf04e7b38f86ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:32:33.910796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:33.911784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ae975324-a4ba-46e6-b4ce-5c7fc9981179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:32:33.913546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1284/2578] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:32:33 2022] DELETE /identity/v3/projects/fe5f74c754ce458eaaf04e7b38f86ebd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:32:42.281853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:42.283679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:42.415015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bd77e-b046-4295-8de4-d63022adedd0 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:42.504706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:42.505550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:42.505836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:42.506112 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:42.507881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:42.522652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:42.524513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f45f6-becd-41f0-9bc1-db9822ada86f service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:42.537755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1295/2579] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:43.904675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:49.013940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:49.014697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:49.014697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] PATH_INFO: `/` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:49.017256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1285/2580] 10.222.0.69 () {54 vars in 921 bytes} [Tue Aug 23 22:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:32:49.023336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:49.023943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:49.023943 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:49.061959 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] MFA Rules not processed for user `c21fbe153d904a19be3b27c499c4f88e`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:49.063202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:49.104430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:32:49.179359 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1296/2581] 10.222.0.69 () {58 vars in 1018 bytes} [Tue Aug 23 22:32:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:32:49.194792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:49.196863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:49.265704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1f24d-a375-422f-b6c6-b63e233fe61c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:49.269838 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:49.270466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:49.270736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:49.271013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:49.283403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:49.286746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3aa30-080d-495d-a065-94cd7653beea service glance] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:49.307545 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1286/2582] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:32:50.587990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:50.589612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:50.656754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b25b57-43b3-4d34-850c-06d2264d2072 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:50.660707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:50.661374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:50.661654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:50.661920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:50.663793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:50.761787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:50.763159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:50.774421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1297/2583] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:32:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:32:51.389293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:51.389781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:51.389878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:51.415776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:32:51.418004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:51.498492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1287/2584] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:32:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:32:51.515775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:32:51.517556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:32:51.614758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39984fa5-41a4-4fb2-93a9-4331efd0aedb service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:32:51.620599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:32:51.621455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:32:51.621797 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:32:51.622227 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:32:51.638174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:32:51.641772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec787541-7d43-4f7b-ae19-9902856e889f service swift] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:32:51.661533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1298/2585] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:32:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:01.489842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=51 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:01.653107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:12.457035 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:12.459685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:12.482114 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a69c8e-1397-40e0-a812-97fd123cdc3c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:12.489627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:12.490694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:12.491189 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:12.491796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:12.497768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:12.617944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:12.621309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:12.643827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1288/2586] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:13.472777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:13.473738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:13.473738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:13.505393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:13.506778 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:13.517092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1299/2587] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:33:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:13.540599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:13.553259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3314ab6-3f1d-4999-b064-1734f9e5b48c service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:13.558733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:13.559372 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:13.559652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:13.559928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:13.571893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:13.573702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:13.584692 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1289/2588] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:33:22.851035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:22.853238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:22.878036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea4432-0f0e-47b0-9356-8bfdba2e4800 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:22.884115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:22.885181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:22.885677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:22.886169 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] PATH_INFO: `/v3/users/d50395a72f664c84bc289ae04a71a5b5` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:22.888690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50395a72f664c84bc289ae04a71a5b5)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:22.893314 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:22.958810 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50395a72f664c84bc289ae04a71a5b5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.959908 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50395a72f664c84bc289ae04a71a5b5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.969988 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50395a72f664c84bc289ae04a71a5b5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.972061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50395a72f664c84bc289ae04a71a5b5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:22.981306 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50395a72f664c84bc289ae04a71a5b5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.004515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1300/2589] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:22 2022] DELETE /identity/v3/users/d50395a72f664c84bc289ae04a71a5b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:23.282332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.303832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba271be-ff16-416a-a6e9-7314103001c7 service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.409093 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.410285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.410783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.411416 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] PATH_INFO: `/v3/projects/6f531eb9f8294ec2a7176d09a525a143` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.413666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f531eb9f8294ec2a7176d09a525a143)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.429024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.506734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f531eb9f8294ec2a7176d09a525a143', 'request_id': 'req-2e54ef8b-cd6c-432e-9201-5f87ce7af691'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.513822 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f531eb9f8294ec2a7176d09a525a143', 'request_id': 'req-2e54ef8b-cd6c-432e-9201-5f87ce7af691'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.521088 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f531eb9f8294ec2a7176d09a525a143', 'request_id': 'req-2e54ef8b-cd6c-432e-9201-5f87ce7af691'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.538524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] The token cache is being invalidate because project 6f531eb9f8294ec2a7176d09a525a143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:23.538818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.539527 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.541184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1290/2590] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:23 2022] DELETE /identity/v3/projects/6f531eb9f8294ec2a7176d09a525a143 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:23.545388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:23.546960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:23.562756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defc1e1-bec0-4a07-85e0-5a5e2e1b953a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:23.647225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:23.648133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:23.648431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:23.648690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] PATH_INFO: `/v3/users/fc61eb61199a4c6b84da10fbe1ad7e17` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:23.650120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc61eb61199a4c6b84da10fbe1ad7e17)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:23.652763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:23.725574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc61eb61199a4c6b84da10fbe1ad7e17'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.726292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc61eb61199a4c6b84da10fbe1ad7e17'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.738280 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc61eb61199a4c6b84da10fbe1ad7e17'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.739508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc61eb61199a4c6b84da10fbe1ad7e17'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.753085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc61eb61199a4c6b84da10fbe1ad7e17'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:23.770131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:23.800445 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1301/2591] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:23 2022] DELETE /identity/v3/users/fc61eb61199a4c6b84da10fbe1ad7e17 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:24.057734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:24.060120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:24.079868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54ef8b-cd6c-432e-9201-5f87ce7af691 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:24.089462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:24.154922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:24.155745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:24.156066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:24.156277 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] PATH_INFO: `/v3/projects/6debace575564ef9a1594fe6fcc85db9` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:24.158334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6debace575564ef9a1594fe6fcc85db9)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:24.160569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:24.228774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6debace575564ef9a1594fe6fcc85db9', 'request_id': 'req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:24.237655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6debace575564ef9a1594fe6fcc85db9', 'request_id': 'req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:24.248176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6debace575564ef9a1594fe6fcc85db9', 'request_id': 'req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:24.273778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] The token cache is being invalidate because project 6debace575564ef9a1594fe6fcc85db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:24.274240 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:24.275424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:24.277589 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1291/2592] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:24 2022] DELETE /identity/v3/projects/6debace575564ef9a1594fe6fcc85db9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:33:32.009057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:32.010555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:32.108443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91551968-0be2-4d40-8149-719bd2b53ddb admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:32.172316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:32.173710 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:32.174061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:32.174285 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:32.177581 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:32.279885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:32.283322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:32.303269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1302/2593] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:34.267703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:35.762269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:35.763865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:35.779247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1ca6-7d21-4d38-bf64-16a4ab4f8b19 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:35.783925 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:35.784598 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:35.784929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:35.785202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] PATH_INFO: `/v3/users/4cf5be327ff749ee901f5fb33ab9f6c8` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:35.805052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cf5be327ff749ee901f5fb33ab9f6c8)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:35.807294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:35.866528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cf5be327ff749ee901f5fb33ab9f6c8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:35.880062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cf5be327ff749ee901f5fb33ab9f6c8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:35.887693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cf5be327ff749ee901f5fb33ab9f6c8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:35.888443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cf5be327ff749ee901f5fb33ab9f6c8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:35.889102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acad16cb-a4cf-4a69-90f5-aa7c70e266ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cf5be327ff749ee901f5fb33ab9f6c8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:35.903836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1292/2594] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:33:35 2022] DELETE /identity/v3/users/4cf5be327ff749ee901f5fb33ab9f6c8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:36.100095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.116834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250d5-0523-441a-a951-afb9204fc103 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.174480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:36.188234 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.189050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.189378 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.189715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] PATH_INFO: `/v3/projects/486ecf70fd6143a6a59e038957b06d50` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.203135 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486ecf70fd6143a6a59e038957b06d50)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.205384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.271396 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486ecf70fd6143a6a59e038957b06d50', 'request_id': 'req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.281575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486ecf70fd6143a6a59e038957b06d50', 'request_id': 'req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.290867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486ecf70fd6143a6a59e038957b06d50', 'request_id': 'req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.303498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] The token cache is being invalidate because project 486ecf70fd6143a6a59e038957b06d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:33:36.303790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.304506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-69e2f4e4-f582-4acc-a7b5-0fa27d55ba82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:33:36.306116 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1303/2595] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:33:36 2022] DELETE /identity/v3/projects/486ecf70fd6143a6a59e038957b06d50 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:36.311432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.311725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.312017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.334606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:36.335849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:36.411485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1293/2596] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:36.420466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.420977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.421389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.445427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:36.446669 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:36.458119 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1304/2597] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:36.463553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.474859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb2580-1b31-464e-a65a-b5761ec7871d None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.480104 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.480736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.481059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.481495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.482323 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:33:36.482633 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.484454 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.498887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1294/2598] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:33:36.504788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.515325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac42ea-7399-4d5d-bdc2-7cbd4b9aaee0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.520485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.521148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.521423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.521692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.522349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.524272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.579279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1305/2599] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:33:36.584656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.596103 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df4022-37ae-443d-a23b-abc8deb5fc60 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.654461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:36.673272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.674247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.674764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.675320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.676539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.680498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.716152 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1295/2600] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:33:36.721860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.733297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af332a1-8919-4c70-a540-b911f8b7d0cb admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.739290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.739999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.740517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.741019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.741909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.743782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.756544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1306/2601] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:36.762879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.791115 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e96c02-0753-4f64-a465-807e0421a728 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.796160 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.796781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.797090 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.797356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.798676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.800320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d21b1-f705-4f62-9092-48407aa4e1cc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.816968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1296/2602] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:33:36.821930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:36.833693 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2366edc-d09d-49ff-b228-666cac47170d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:36.839662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:36.840377 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.840652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.840955 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] PATH_INFO: `/v3/projects/dd3cb603326f41ffa59b7ca57408f390/users/017f19fdb79140ab9785acb65b20f1eb/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.859132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3cb603326f41ffa59b7ca57408f390, user_id=017f19fdb79140ab9785acb65b20f1eb, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:36.862707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:36.880729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1307/2603] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:33:36 2022] PUT /identity/v3/projects/dd3cb603326f41ffa59b7ca57408f390/users/017f19fdb79140ab9785acb65b20f1eb/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:33:36.887390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9230-2327-4de3-8d33-b6004e1676ce None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:36.887960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9230-2327-4de3-8d33-b6004e1676ce None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:36.888490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d9230-2327-4de3-8d33-b6004e1676ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:36.923704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-913d9230-2327-4de3-8d33-b6004e1676ce None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:36.925858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-913d9230-2327-4de3-8d33-b6004e1676ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:37.004937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1297/2604] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:37.019982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:37.021878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:37.093821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17547dc0-b984-4eb5-9e0f-3488c4658619 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:37.100287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:37.101298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:37.101298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:37.101298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:37.112655 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:37.114585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:37.126092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1308/2605] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:41.909503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2193e42-8688-4029-b55f-bea3dc48ff07 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:41.910362 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2193e42-8688-4029-b55f-bea3dc48ff07 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:41.910808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2193e42-8688-4029-b55f-bea3dc48ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:41.953403 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b2193e42-8688-4029-b55f-bea3dc48ff07 None None] MFA Rules not processed for user `017f19fdb79140ab9785acb65b20f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:41.955091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b2193e42-8688-4029-b55f-bea3dc48ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:42.077336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1298/2606] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:33:42.100801 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:42.103033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:42.112397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:42.214168 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41345ce7-238e-433d-a041-d2f6ffd535c5 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:42.220775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:42.221442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:42.221717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:42.221991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:42.230728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:42.232356 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:42.243659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1309/2607] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:43.890800 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:43.892494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:43.892774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:43.923429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] MFA Rules not processed for user `017f19fdb79140ab9785acb65b20f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:33:43.925029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:43.939947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1299/2608] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:33:44.021537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:44.023707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:44.145995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb538f9-e3ac-49cb-9b57-01c66ee422cb service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:44.152647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:44.153770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:44.154266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:44.154753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:44.158379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:44.186386 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:44.189101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:44.205180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1310/2609] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:33:45.148487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:45.160873 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78507-dcc8-44eb-87be-2895f747d96c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:45.165746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:45.166475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:45.166768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:45.167043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:45.169124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:45.186361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:45.187837 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:45.202481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1300/2610] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:54.198383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=59 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:55.195889 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:30.152860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:30.169812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1a7f-d5ce-4928-aac1-14d6fdb8941e service glance] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:30.177298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:30.178370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:30.178874 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:30.179367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:30.182895 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:30.206122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:30.208664 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:30.229744 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1311/2611] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:36.202881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:36.206289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:36.231752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698196c-524a-426d-8922-26233e859bd5 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:36.240265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:36.241441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:36.241957 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:36.242298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] PATH_INFO: `/v3/users/f3095b1ac2464cf8b9302eea60ba2c4b` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:36.267102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3095b1ac2464cf8b9302eea60ba2c4b)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:36.269511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:36.366741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3095b1ac2464cf8b9302eea60ba2c4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:36.397727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3095b1ac2464cf8b9302eea60ba2c4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:36.413478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3095b1ac2464cf8b9302eea60ba2c4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:36.414727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3095b1ac2464cf8b9302eea60ba2c4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:36.415908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-da405f4e-74dd-4a97-a80f-87dddf349376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3095b1ac2464cf8b9302eea60ba2c4b'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:36.440704 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1301/2612] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:36 2022] DELETE /identity/v3/users/f3095b1ac2464cf8b9302eea60ba2c4b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:36.755204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:36.776854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe124afd-fe42-4680-a346-280ed602c34e service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:36.899266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:36.900480 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:36.901132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:36.901552 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] PATH_INFO: `/v3/projects/24eb07d7a8f7432495673d1be4036687` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:36.925717 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24eb07d7a8f7432495673d1be4036687)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:36.929702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.016337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24eb07d7a8f7432495673d1be4036687', 'request_id': 'req-c83ec8a0-7717-4cea-bf53-702832fc393e'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:37.027361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24eb07d7a8f7432495673d1be4036687', 'request_id': 'req-c83ec8a0-7717-4cea-bf53-702832fc393e'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:37.037499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24eb07d7a8f7432495673d1be4036687', 'request_id': 'req-c83ec8a0-7717-4cea-bf53-702832fc393e'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:37.053460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] The token cache is being invalidate because project 24eb07d7a8f7432495673d1be4036687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:37.053952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:37.054954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-c83ec8a0-7717-4cea-bf53-702832fc393e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:37.056934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1312/2613] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:36 2022] DELETE /identity/v3/projects/24eb07d7a8f7432495673d1be4036687 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:37.063179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.063552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.063849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.089177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:37.090610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:37.205913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1302/2614] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:37.222568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.223102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.223616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.260132 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:37.262441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:37.285331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1313/2615] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:37.292630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.320676 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327e8fc-d5a7-457a-ba1d-aa03477d5d31 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.329688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.330797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.331341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.331803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.333125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:37.333686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.337056 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.363441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1303/2616] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:37.371099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.391027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd976-09d9-42d6-9a1e-0692df874f79 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.399699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.400866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.401382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.401880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.403092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.407650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.484395 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1314/2617] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:37 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:37.490139 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.508390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1e809-1789-43ce-bdca-2a3cbcdc886f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.602395 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:37.630754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.631805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.632282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.632768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.633989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.637884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.682556 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1304/2618] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:37 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:37.690475 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.713307 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d5803-3e9d-4f37-a5e0-83e5fccede6a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.723950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.725188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.725673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.726235 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.728016 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.732738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.758200 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1315/2619] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:37.766006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.786394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4d286-445e-49c1-8e5e-48ceabb3a071 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.795320 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.796942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.797457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.797910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.799196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.802389 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43109180-ab07-484d-b6e3-f1d5061f083f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.826274 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1305/2620] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:37.833273 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:37.852246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efaf40-161c-4389-bcb8-7fc0ea37d69e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:37.861447 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:37.862586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.863059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.863515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] PATH_INFO: `/v3/projects/aed042bded464541bf76c502b6d640a3/users/415a75322c83477492293012cce4ede0/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:37.894149 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=aed042bded464541bf76c502b6d640a3, user_id=415a75322c83477492293012cce4ede0, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:37.899545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:37.923737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1316/2621] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:37 2022] PUT /identity/v3/projects/aed042bded464541bf76c502b6d640a3/users/415a75322c83477492293012cce4ede0/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:37.945400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:37.945953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:37.946806 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:38.004427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] MFA Rules not processed for user `415a75322c83477492293012cce4ede0`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:38.006643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:38.149388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1306/2622] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:38.170256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:38.173123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:38.185421 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:38.297094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46999a-4994-4fe0-aaf5-94a92e01a6be admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:38.303478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:38.306152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:38.306152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:38.306152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:38.315423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:38.317586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94ec92-59d1-4e2e-a788-3eed7e85d5b9 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:38.330613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1317/2623] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:34:41.657262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:41.784369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3c053-c920-4d74-b2b3-44960e4c8a5e None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:41.793172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:41.794303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:41.794814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:41.795330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] PATH_INFO: `/v3/users/415a75322c83477492293012cce4ede0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:41.799284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] RBAC: Authorizing `identity:delete_user(user_id=415a75322c83477492293012cce4ede0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:41.803457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:41.902052 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415a75322c83477492293012cce4ede0'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.921228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:41.933681 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415a75322c83477492293012cce4ede0'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.951478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415a75322c83477492293012cce4ede0'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.953657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415a75322c83477492293012cce4ede0'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.954667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415a75322c83477492293012cce4ede0'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:41.984705 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1307/2624] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:41 2022] DELETE /identity/v3/users/415a75322c83477492293012cce4ede0 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:41.990154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:41.991011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:41.991011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.016456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:42.018881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:42.137163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1318/2625] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:42.149404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:42.151583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:42.267516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968e9b0-4e08-4bfa-a893-02559f1e143b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:42.274606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:42.275804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.276326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.276886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.297894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:42.300629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30976fed-f1e5-4e19-9066-5cd976515248 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:42.321245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1308/2626] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:42.765553 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:42.767998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:42.792192 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e908ba-6e2c-4cff-9bd4-ffa57043c8d1 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:42.803387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:42.805318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.805546 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.806313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] PATH_INFO: `/v3/projects/aed042bded464541bf76c502b6d640a3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:42.808781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aed042bded464541bf76c502b6d640a3)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:42.813773 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:42.917340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed042bded464541bf76c502b6d640a3', 'request_id': 'req-2d66800f-7053-40e0-8d92-19e66f47caf0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.933527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed042bded464541bf76c502b6d640a3', 'request_id': 'req-2d66800f-7053-40e0-8d92-19e66f47caf0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.948671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed042bded464541bf76c502b6d640a3', 'request_id': 'req-2d66800f-7053-40e0-8d92-19e66f47caf0'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.973497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] The token cache is being invalidate because project aed042bded464541bf76c502b6d640a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:42.973973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.975037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-2d66800f-7053-40e0-8d92-19e66f47caf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:42.977264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1319/2627] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:42 2022] DELETE /identity/v3/projects/aed042bded464541bf76c502b6d640a3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:42.983140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:42.983929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:42.983929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.009694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:43.011155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.127921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1309/2628] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:43.143995 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.144850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.145039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.186700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:43.189059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.210822 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1320/2629] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:43.212727 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.228548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c12495-91f3-4ab8-9f99-e99cb3f4eb11 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.238131 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.239003 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.239408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.239778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.240961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:43.241412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.243900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.263651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1310/2630] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:43.271093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.287579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd742-969d-4cd8-ab98-c5a3fd1a4418 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.297076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.298405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.298885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.299361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.300513 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.304634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.314337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:43.352682 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1321/2631] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/projects => generated 405 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:43.358420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.371246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c14c97-d236-4f37-abb3-ddb6de502bcd admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.502479 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.503530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.504016 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.504510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.505725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.509660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.529512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:43.549968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1311/2632] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:43.554201 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.573420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad3815-4da5-4713-8ccc-3138493aacf6 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.583883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.585039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.585580 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.586330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.587768 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.590887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.612986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1322/2633] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:43.618626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.633836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0e28b-e61d-498f-abf2-9da5f15991ad admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.642824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.643890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.644361 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.644989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.646201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.649392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f21bb-3b47-4512-8b0b-fbb23e345f31 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.672149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1312/2634] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:43.679233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:43.695603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f6458-65eb-445a-b6d4-2a3f9cd83e80 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:43.703429 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:43.704707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.705283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.705819 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] PATH_INFO: `/v3/projects/c1907a06579843f687f6cd59cdcdbc28/users/119a774ea8aa4f519d99f29f2aa2056d/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.734060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1907a06579843f687f6cd59cdcdbc28, user_id=119a774ea8aa4f519d99f29f2aa2056d, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:43.737340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:43.755902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1323/2635] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:43 2022] PUT /identity/v3/projects/c1907a06579843f687f6cd59cdcdbc28/users/119a774ea8aa4f519d99f29f2aa2056d/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:43.773459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:43.773949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:43.774473 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:43.822538 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] MFA Rules not processed for user `119a774ea8aa4f519d99f29f2aa2056d`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:43.823811 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:43.935848 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1313/2636] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:43.941700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.066371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85986198-330c-437d-aec1-e0c627cd2728 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.075175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.076272 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.076840 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.077649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.078512 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.082250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.132492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1324/2637] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:43 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:44.136663 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.152155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0074ad-e678-40a7-8adc-2148351410f2 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.260307 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.261299 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.261779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.262269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.263422 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.268779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.314216 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1314/2638] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:44 2022] POST /identity/v3/users => generated 308 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:44.319325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.334894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950f54f-4253-44e6-818f-cf1e88ae3111 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.343146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.344213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.344687 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.345224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.346346 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.348398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.365510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1325/2639] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:44.370996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.386996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b5d62-44c8-4106-8226-e98a272d78a6 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.396267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.397234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.397610 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.398023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] PATH_INFO: `/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40/users/00470943104c45d98619883a8920735b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.421106 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ed7d2a5ca243648bdf81a8c68d5e40, user_id=00470943104c45d98619883a8920735b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.424612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.444706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1315/2640] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:44 2022] PUT /identity/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40/users/00470943104c45d98619883a8920735b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:44.449572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.462101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87f79a-c086-4efd-97ed-7bcc0becda5a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.568772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.569924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.570425 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.570927 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.572153 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.575369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e440a28-a1d3-4d8b-8cbc-7e263f896712 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.598582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1326/2641] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:44.603558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.617378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd85851-4bbc-4473-8993-64d92bf66e78 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.624565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.626433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.626842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.627218 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] PATH_INFO: `/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40/users/00470943104c45d98619883a8920735b/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.630346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ed7d2a5ca243648bdf81a8c68d5e40, user_id=00470943104c45d98619883a8920735b, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:44.636081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:44.652955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1316/2642] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:44 2022] PUT /identity/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40/users/00470943104c45d98619883a8920735b/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:44.666237 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.666791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.667331 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:44.724267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] MFA Rules not processed for user `00470943104c45d98619883a8920735b`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:44.726415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:44.743251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:44.867700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1327/2643] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:44 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:44.886439 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:44.891001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:44.947954 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:44.993033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4d1c-7885-4589-b373-8291292c403d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:44.998331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:44.999287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:44.999287 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:44.999623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.017290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.018987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc16c13-69c4-4db1-a46d-c75bd096d361 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.032029 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1317/2644] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:45.262529 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.357868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b3a8c-3c3c-4e18-9f93-7c13bc086411 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.363251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.364066 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.364468 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.364871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] PATH_INFO: `/v3/users/119a774ea8aa4f519d99f29f2aa2056d` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.366278 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119a774ea8aa4f519d99f29f2aa2056d)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.368550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.435679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119a774ea8aa4f519d99f29f2aa2056d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.437226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119a774ea8aa4f519d99f29f2aa2056d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.447609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119a774ea8aa4f519d99f29f2aa2056d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.448639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119a774ea8aa4f519d99f29f2aa2056d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.463432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119a774ea8aa4f519d99f29f2aa2056d'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:45.502856 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1328/2645] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:45 2022] DELETE /identity/v3/users/119a774ea8aa4f519d99f29f2aa2056d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:45.510834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.511512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.511799 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.548846 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:45.551276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.666421 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1318/2646] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:45.683443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:45.685514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:45.736204 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:45.794990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e49035e-4a4c-4b11-944f-a8665b95a545 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:45.799830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:45.800489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:45.800770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:45.801126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:45.816383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:45.819510 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:45.840161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1329/2647] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:46.370900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.372626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:46.403261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5a38-284e-447d-a8b4-bdf35409b79a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.409085 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.409906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.410185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.410457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] PATH_INFO: `/v3/projects/c1907a06579843f687f6cd59cdcdbc28` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.412024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1907a06579843f687f6cd59cdcdbc28)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.414150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.503465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1907a06579843f687f6cd59cdcdbc28', 'request_id': 'req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.513377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1907a06579843f687f6cd59cdcdbc28', 'request_id': 'req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.523138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1907a06579843f687f6cd59cdcdbc28', 'request_id': 'req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.541400 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] The token cache is being invalidate because project c1907a06579843f687f6cd59cdcdbc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:46.542051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.542915 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.544765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1319/2648] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:46 2022] DELETE /identity/v3/projects/c1907a06579843f687f6cd59cdcdbc28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:46.550738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.565301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2065d-89c4-448b-ab3c-9f3fe7b37b3a service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:46.684038 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:46.685114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:46.685403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:46.685721 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] PATH_INFO: `/v3/users/00470943104c45d98619883a8920735b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:46.688997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00470943104c45d98619883a8920735b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:46.691793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:46.791524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00470943104c45d98619883a8920735b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.792380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00470943104c45d98619883a8920735b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.815894 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00470943104c45d98619883a8920735b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.817426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00470943104c45d98619883a8920735b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.829614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00470943104c45d98619883a8920735b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:46.863220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1330/2649] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:46 2022] DELETE /identity/v3/users/00470943104c45d98619883a8920735b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:46.963390 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:46.966827 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.073242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52f7f-a516-4c50-ae17-0990a7d46d0c admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.080749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:47.169506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.171739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.171739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.173332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.176849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.197374 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.200474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e13132-5ea2-4fd3-86a9-f6c70b344d4f service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.217741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1320/2650] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:47.413002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.417404 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.535049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:47.570644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28c0c4-86bb-494f-9793-7fb889ceea6b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.576333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.577133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.577291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.577555 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] PATH_INFO: `/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.578889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ed7d2a5ca243648bdf81a8c68d5e40)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.580966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.665992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ed7d2a5ca243648bdf81a8c68d5e40', 'request_id': 'req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:47.688537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ed7d2a5ca243648bdf81a8c68d5e40', 'request_id': 'req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:47.701530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ed7d2a5ca243648bdf81a8c68d5e40', 'request_id': 'req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:47.719214 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] The token cache is being invalidate because project d2ed7d2a5ca243648bdf81a8c68d5e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:47.719740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:47.720618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-98d2ed62-43d6-44e9-9e05-262ce4bbb0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:47.722878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1331/2651] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:47 2022] DELETE /identity/v3/projects/d2ed7d2a5ca243648bdf81a8c68d5e40 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:47.730936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.731814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.731814 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.764783 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:47.766300 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.864658 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1321/2652] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:47.874549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.874835 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.875107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.907829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:47.909282 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:47.918075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1332/2653] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:47.923111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.937688 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d5b79-b2e3-4359-93ac-c3da08e268e0 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.943599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.944272 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.944605 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.944918 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.945592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:47.945899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.947532 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:47.964782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1322/2654] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:47.966545 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:47.980318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f031534-44d7-4af2-bd2b-a9c59f0a2ebc None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:47.986866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:47.992330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:47.992716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:47.993019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:47.993759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:47.995922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.034592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1333/2655] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:47 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:48.039632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.052062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f07bd-8d04-41c0-b1c5-4cc345978617 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.125025 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.125684 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.125961 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.126228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.126921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.128926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.163049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1323/2656] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:48 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:48.167245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.183025 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee08e3c-d7ae-4029-9c08-a63b3ca51dc7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.188792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.189474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.189754 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.190027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.190690 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.192830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.206556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1334/2657] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:48.213235 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.231335 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35f2b5-9251-47c7-90bb-10c9a62f64c5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.236703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.237346 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.237622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.237893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.238554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.240174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc6ea3-62c4-4239-aa25-da8b8421c7dc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.254480 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1324/2658] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:48.259634 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.272713 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69532b36-7d82-4d3c-b24a-800ae8c0a7d0 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.278211 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.278983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.279565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.280315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] PATH_INFO: `/v3/projects/ee6d9126c4434f10b3d38cd7c3569b03/users/24d55e1e5d794e62a3682a0be0772e16/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.297472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6d9126c4434f10b3d38cd7c3569b03, user_id=24d55e1e5d794e62a3682a0be0772e16, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.300645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.317973 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1335/2659] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:48 2022] PUT /identity/v3/projects/ee6d9126c4434f10b3d38cd7c3569b03/users/24d55e1e5d794e62a3682a0be0772e16/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:48.330530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.330796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.331109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.363735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] MFA Rules not processed for user `24d55e1e5d794e62a3682a0be0772e16`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:48.365027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:48.370912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:48.456951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1325/2660] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:48.462807 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.543845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d931-2f71-41f0-b92a-e68344be903a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.549277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.549910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.550188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.550455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.551097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.553077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.579202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:48.588689 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1336/2661] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:48 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:48.599276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.612666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1abdb0-b146-47b9-9f1b-11d038379ddc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.840170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.841151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.841630 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.843264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.844171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.846899 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.872884 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1326/2662] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:48 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:48.877826 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.889711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd709f-72e2-4235-9d6b-ac5a2d73432b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.894817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.895542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.895829 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.896109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.896761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.898417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:48.912294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1337/2663] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:48.919440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:48.937471 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86940840-8aa6-4266-918a-f4ccc7aa2244 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:48.945677 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:48.946449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:48.946909 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:48.947376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] PATH_INFO: `/v3/projects/c16db422596f4b52bd2c9e9ddf305082/users/1f982b1de42d4b25b975371d671ef962/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:48.977334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16db422596f4b52bd2c9e9ddf305082, user_id=1f982b1de42d4b25b975371d671ef962, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:48.983836 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.004603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1327/2664] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:48 2022] PUT /identity/v3/projects/c16db422596f4b52bd2c9e9ddf305082/users/1f982b1de42d4b25b975371d671ef962/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:49.013484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:49.036221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2188231-789f-4f39-bd1a-cca942f4502c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:49.126467 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:49.127023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.127309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.127596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.128287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:49.130043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9913-7c03-40bd-976b-266dddacf893 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.149925 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1338/2665] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:49.155771 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:49.173888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ef8b2-a0ad-4610-baa5-474144b847dc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:49.181721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:49.182793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.183238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.183695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] PATH_INFO: `/v3/projects/c16db422596f4b52bd2c9e9ddf305082/users/1f982b1de42d4b25b975371d671ef962/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.187810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16db422596f4b52bd2c9e9ddf305082, user_id=1f982b1de42d4b25b975371d671ef962, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:49.193548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.213427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1328/2666] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:49 2022] PUT /identity/v3/projects/c16db422596f4b52bd2c9e9ddf305082/users/1f982b1de42d4b25b975371d671ef962/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:49.230207 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.230493 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.230817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.271650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] MFA Rules not processed for user `1f982b1de42d4b25b975371d671ef962`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:49.272520 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:49.366818 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1339/2667] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:49.381364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:49.383872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:49.472791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65639c35-a7fa-4ec4-85e7-0f94a06c4faf admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:49.478142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:49.479015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:49.479357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:49.479662 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:49.493483 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:49.495081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2aea4-7833-453e-bdd5-0469906fdf05 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:49.507617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1329/2668] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:50.083560 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:50.163370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba93c9c-2525-4083-a8ea-d7a22bf5a460 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:50.171084 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:50.171557 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:50.171745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:50.172008 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] PATH_INFO: `/v3/users/24d55e1e5d794e62a3682a0be0772e16` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:50.173354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d55e1e5d794e62a3682a0be0772e16)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:50.175508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:50.192686 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=100 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:50.251349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d55e1e5d794e62a3682a0be0772e16'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.253077 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d55e1e5d794e62a3682a0be0772e16'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.265805 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d55e1e5d794e62a3682a0be0772e16'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.266559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d55e1e5d794e62a3682a0be0772e16'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.282788 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d55e1e5d794e62a3682a0be0772e16'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:50.311309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1340/2669] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:50 2022] DELETE /identity/v3/users/24d55e1e5d794e62a3682a0be0772e16 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:50.317982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:50.318878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:50.318878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:50.328654 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:50.351435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:50.353795 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:50.469193 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1330/2670] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:50.484199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:50.487868 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:50.597624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fe220-4e98-4719-b7a5-ca5e08d8213e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:50.602783 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:50.603486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:50.603767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:50.604045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:50.615577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:50.617417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:50.630173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1341/2671] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:51.057824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:51.059987 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:51.077134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c26ad-2484-4fd2-b3bd-3ea1a16d7996 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:51.082953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:51.083736 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:51.084231 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:51.084488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] PATH_INFO: `/v3/projects/ee6d9126c4434f10b3d38cd7c3569b03` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:51.086091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6d9126c4434f10b3d38cd7c3569b03)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:51.088458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:51.167666 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6d9126c4434f10b3d38cd7c3569b03', 'request_id': 'req-6d877494-63b2-4131-b499-b3ab8acc2e9f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.180120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6d9126c4434f10b3d38cd7c3569b03', 'request_id': 'req-6d877494-63b2-4131-b499-b3ab8acc2e9f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.185262 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6d9126c4434f10b3d38cd7c3569b03', 'request_id': 'req-6d877494-63b2-4131-b499-b3ab8acc2e9f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.214474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] The token cache is being invalidate because project ee6d9126c4434f10b3d38cd7c3569b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:51.214941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.216043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.219552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1331/2672] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:51 2022] DELETE /identity/v3/projects/ee6d9126c4434f10b3d38cd7c3569b03 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:51.225412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:51.238163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd47ac-d471-44c6-9a22-038fbb8a48c6 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:51.310885 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:51.311522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:51.311960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:51.312410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] PATH_INFO: `/v3/users/1f982b1de42d4b25b975371d671ef962` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:51.313741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f982b1de42d4b25b975371d671ef962)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:51.315708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:51.358000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:51.377277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f982b1de42d4b25b975371d671ef962'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.378049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f982b1de42d4b25b975371d671ef962'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.387949 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f982b1de42d4b25b975371d671ef962'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.388675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f982b1de42d4b25b975371d671ef962'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.398769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-f981f47e-10d4-45de-8a52-9f96ea1446a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f982b1de42d4b25b975371d671ef962'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:51.420056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1342/2673] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:51 2022] DELETE /identity/v3/users/1f982b1de42d4b25b975371d671ef962 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:51.815399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:51.817928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:51.836484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d877494-63b2-4131-b499-b3ab8acc2e9f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:51.938919 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:51.939465 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:51.939745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:51.940014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] PATH_INFO: `/v3/projects/c16db422596f4b52bd2c9e9ddf305082` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:51.941330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16db422596f4b52bd2c9e9ddf305082)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:51.943651 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:51.989111 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:52.015753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16db422596f4b52bd2c9e9ddf305082', 'request_id': 'req-70b67bb2-de3d-4a12-bee0-0127c2f53a07'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:52.026636 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16db422596f4b52bd2c9e9ddf305082', 'request_id': 'req-70b67bb2-de3d-4a12-bee0-0127c2f53a07'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:52.036928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16db422596f4b52bd2c9e9ddf305082', 'request_id': 'req-70b67bb2-de3d-4a12-bee0-0127c2f53a07'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:52.056788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] The token cache is being invalidate because project c16db422596f4b52bd2c9e9ddf305082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:52.057135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:52.057850 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-70b67bb2-de3d-4a12-bee0-0127c2f53a07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:52.062050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1332/2674] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:51 2022] DELETE /identity/v3/projects/c16db422596f4b52bd2c9e9ddf305082 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:52.068059 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.068357 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.068626 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.091992 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:52.094244 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.187184 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1343/2675] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.201077 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.202079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.202596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.235928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:52.238291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.248716 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1333/2676] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.253561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.265415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63a1e-60e6-4146-9420-d07d65b9257e None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.270551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.271198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.271456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.271730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.272401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:52.272704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.274383 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.294570 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1344/2677] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:34:52.300970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.311788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0c5ff-f1d7-4d55-ab0f-a4ac421ecf1a None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.318197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.318898 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.319172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.319440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.320145 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.322248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.359011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1334/2678] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:52.365187 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.381100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c582-f3ce-4ef1-8cad-588ae8e59857 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.475048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.475610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.475886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.476373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.477373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.479417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.514367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1345/2679] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:52.519949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.537774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffa7ee-2a53-4e0b-8b36-5eddd5cc20bb admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.543722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.544355 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.544650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.545792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.546270 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.548071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.567366 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1335/2680] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:52.573803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.586178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eb211-3f52-4b4c-98a4-0153c97df02c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.594233 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.595102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.595455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.595753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.596972 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.599400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fc102-67c2-447c-8030-b1a901900f84 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.618699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1346/2681] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:52.627333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.639542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599ba5-3fe5-410e-86b8-3f4aedc592ac admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.647138 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.648028 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.648354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.648697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] PATH_INFO: `/v3/projects/76df6067d62c45da85d0b2da2f2f619a/users/6b08379d8a8a49c7aab98dad88f10227/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.668860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76df6067d62c45da85d0b2da2f2f619a, user_id=6b08379d8a8a49c7aab98dad88f10227, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.673490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.689215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1336/2682] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:52 2022] PUT /identity/v3/projects/76df6067d62c45da85d0b2da2f2f619a/users/6b08379d8a8a49c7aab98dad88f10227/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:52.700365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.700648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.700989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.731166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] MFA Rules not processed for user `6b08379d8a8a49c7aab98dad88f10227`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:52.732295 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:52.737161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:52.807387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1347/2683] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:52.812719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.885105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9e7a6-e93c-4682-9acf-288d5c33ac29 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:52.890587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:52.891207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:52.891629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:52.891990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:52.892643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:52.894622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:52.925245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1337/2684] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:52.929877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:52.942326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd81dd-33df-4af1-80f9-844f4f90f22c None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.009415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.010015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.010296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.010571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.011198 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.013179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.036619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1348/2685] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:52 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:53.040572 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.060476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33de5-c95e-4ebc-bd4d-d4db6a2d6b93 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.067015 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.067652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.067927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.068221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.069461 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.070970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.091678 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1338/2686] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:34:53.095917 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.107096 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587574d-1df7-41bd-9ef3-849f132f96b2 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.117305 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.118415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.119129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.121289 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] PATH_INFO: `/v3/projects/d00a924febb04fb1a71b6ed316835510/users/67d91b5153fc4e50a21de9bc906a5268/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.265796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00a924febb04fb1a71b6ed316835510, user_id=67d91b5153fc4e50a21de9bc906a5268, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.268654 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.289611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1349/2687] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:53 2022] PUT /identity/v3/projects/d00a924febb04fb1a71b6ed316835510/users/67d91b5153fc4e50a21de9bc906a5268/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:53.294561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.307318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46580-fe7f-41d9-91e9-7e007dbd5480 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.337032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:53.377310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.377936 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.378210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.378481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.379125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.380710 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee0d88-fb12-465d-81e9-fe3985f46a5b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.391354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1339/2688] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:53.395614 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.408443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5bae3-8f34-45b6-8ac9-c8413c0a389e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.413361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.414053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.414402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.414691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] PATH_INFO: `/v3/projects/d00a924febb04fb1a71b6ed316835510/users/67d91b5153fc4e50a21de9bc906a5268/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.416605 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00a924febb04fb1a71b6ed316835510, user_id=67d91b5153fc4e50a21de9bc906a5268, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.419414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.431326 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1350/2689] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:53 2022] PUT /identity/v3/projects/d00a924febb04fb1a71b6ed316835510/users/67d91b5153fc4e50a21de9bc906a5268/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:53.443242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.443497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.443763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.476412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] MFA Rules not processed for user `67d91b5153fc4e50a21de9bc906a5268`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:53.478512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:53.559094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1340/2690] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:53.578102 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.580071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:53.655873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705d233-2d7f-48d5-a9d0-5c43e3af74c5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.661952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.662766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.663065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.663340 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.674594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.677839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5b4d0-eb83-4650-8c35-93a34b0d2c18 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.684472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:53.694889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1351/2691] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:53.738308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:53.823793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d62b-3614-4fd6-9845-43d891bff4ab None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:53.830567 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:53.831233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.831693 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.832179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] PATH_INFO: `/v3/users/6b08379d8a8a49c7aab98dad88f10227` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.834290 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b08379d8a8a49c7aab98dad88f10227)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:53.838224 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:53.923470 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b08379d8a8a49c7aab98dad88f10227'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:53.926708 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:53.943079 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b08379d8a8a49c7aab98dad88f10227'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:53.950640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b08379d8a8a49c7aab98dad88f10227'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:53.951426 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b08379d8a8a49c7aab98dad88f10227'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:53.952042 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b08379d8a8a49c7aab98dad88f10227'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:53.967313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1341/2692] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:53 2022] DELETE /identity/v3/users/6b08379d8a8a49c7aab98dad88f10227 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:53.972496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:53.972921 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:53.973250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:53.997697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:53.999094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:54.084944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1352/2693] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:54.098933 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:54.100754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:54.192923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd14e24-e874-4265-9e7a-bef6bb8fbd68 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:54.197313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:54.198083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:54.198463 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:54.198831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:54.210554 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:54.212050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:54.227512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1342/2694] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:54.619090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:54.621023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:54.635848 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebaf23-3c33-4f5d-b5ac-f1376ababe01 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:54.641333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:54.642502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:54.642695 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:54.643015 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] PATH_INFO: `/v3/projects/76df6067d62c45da85d0b2da2f2f619a` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:54.644575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76df6067d62c45da85d0b2da2f2f619a)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:54.647256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:54.724727 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76df6067d62c45da85d0b2da2f2f619a', 'request_id': 'req-fca27b7f-e3bb-4851-9d43-a696c48c7c29'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.734971 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76df6067d62c45da85d0b2da2f2f619a', 'request_id': 'req-fca27b7f-e3bb-4851-9d43-a696c48c7c29'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.747933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76df6067d62c45da85d0b2da2f2f619a', 'request_id': 'req-fca27b7f-e3bb-4851-9d43-a696c48c7c29'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.769392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] The token cache is being invalidate because project 76df6067d62c45da85d0b2da2f2f619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:54.769888 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.770979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.773683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1353/2695] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:54 2022] DELETE /identity/v3/projects/76df6067d62c45da85d0b2da2f2f619a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:34:54.779698 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:54.798011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e49a65-6845-4f9a-8c92-607c232184af service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:54.876334 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:54.876910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:54.877201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:54.877472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] PATH_INFO: `/v3/users/67d91b5153fc4e50a21de9bc906a5268` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:54.878756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d91b5153fc4e50a21de9bc906a5268)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:54.880773 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:54.950246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d91b5153fc4e50a21de9bc906a5268'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.969128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d91b5153fc4e50a21de9bc906a5268'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.976550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:54.979200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d91b5153fc4e50a21de9bc906a5268'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.980573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d91b5153fc4e50a21de9bc906a5268'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:54.982248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-131a0996-ea3a-444e-aa86-2e685085d675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d91b5153fc4e50a21de9bc906a5268'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.002883 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1343/2696] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:34:54 2022] DELETE /identity/v3/users/67d91b5153fc4e50a21de9bc906a5268 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:55.426566 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.428394 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:55.453092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca27b7f-e3bb-4851-9d43-a696c48c7c29 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:55.553866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:55.554662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.554969 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.555293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] PATH_INFO: `/v3/projects/d00a924febb04fb1a71b6ed316835510` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.556759 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00a924febb04fb1a71b6ed316835510)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:55.558765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:55.611958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:55.635715 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00a924febb04fb1a71b6ed316835510', 'request_id': 'req-5186cb58-5077-4621-a5e6-9b145b6da99c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.647179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00a924febb04fb1a71b6ed316835510', 'request_id': 'req-5186cb58-5077-4621-a5e6-9b145b6da99c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.656533 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00a924febb04fb1a71b6ed316835510', 'request_id': 'req-5186cb58-5077-4621-a5e6-9b145b6da99c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.668074 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] The token cache is being invalidate because project d00a924febb04fb1a71b6ed316835510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:34:55.668390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.668940 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-5186cb58-5077-4621-a5e6-9b145b6da99c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:34:55.671460 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1354/2697] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:34:55 2022] DELETE /identity/v3/projects/d00a924febb04fb1a71b6ed316835510 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:55.676927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.677310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.677622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.705777 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:55.707023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:55.798788 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1344/2698] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:55.807403 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.807741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.808086 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.833048 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:55.834279 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:55.844481 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1355/2699] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:34:55.850070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.864469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429304c-adef-46f8-8fb0-900bcaea15a7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:55.872159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:55.873947 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.874665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.875208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.876066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:34:55.876456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:55.879699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:55.901951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1345/2700] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:34:55.908380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.919485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05142b-bec3-467e-a33a-943c07a8b367 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:55.924998 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:55.925631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:55.925890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:55.926173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:55.926844 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:55.928841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:55.966315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1356/2701] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:55 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:55.973238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:55.986284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1adf8-ba0a-4eab-9e0d-791f32da7bef admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.073113 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.074154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.074643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.075128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.076887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.080687 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.111503 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1346/2702] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:55 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:56.118369 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.131732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3de5a-65ed-40a3-927f-64378d7151f7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.137353 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.138063 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.138402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.139647 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.139954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.141849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.153942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1357/2703] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:56.158763 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.170626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ace6b9-c854-4890-a3ce-1c9822f9af6f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.175669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.176252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.176529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.176841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.177507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.179150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc96e96-33e4-420a-bbeb-4480a3fb88d5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.194179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1347/2704] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:56.199739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.212750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c03f09-ea2b-4083-a5b7-b6a0a0eb540f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.220476 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.221880 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.222433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.222961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] PATH_INFO: `/v3/projects/256903140a204ea7997cd3928bd67ad9/users/94de89f26acc40e6880123965918068b/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.247292 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256903140a204ea7997cd3928bd67ad9, user_id=94de89f26acc40e6880123965918068b, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.252913 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.278076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1358/2705] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:56 2022] PUT /identity/v3/projects/256903140a204ea7997cd3928bd67ad9/users/94de89f26acc40e6880123965918068b/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:56.297722 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.298151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.298529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.338096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] MFA Rules not processed for user `94de89f26acc40e6880123965918068b`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:56.339546 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:56.419177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:56.460116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1348/2706] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:56.465538 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.554559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672a3d8-dc34-47bc-a001-95ff5f61b1d1 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.559636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.560267 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.561140 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.561539 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.562410 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.564388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.601082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1359/2707] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:56 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:56.608737 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.627092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf85e7-3b34-49d9-971c-c5bd48ad163c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.710327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.711001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.711285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.711590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.712248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.714347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.743878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1349/2708] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:56 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:56.749968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.769968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3ceb-547d-4f7b-9f84-717ee92133b0 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.779240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.780660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.781241 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.781675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.782911 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.786137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.807260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1360/2709] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:56.814510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.829319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33927b85-7d67-4746-9be9-34be792ae66f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.834989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.835742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.836128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.836497 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.837331 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.839358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc5b30-1c67-48a9-9810-f090e478f60f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.854350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1350/2710] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:56.861524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:56.880044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e982-0be8-40be-acf9-53d93dcbb415 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:56.888485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:56.891196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.891596 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.892108 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] PATH_INFO: `/v3/projects/9303fdefbfcf4bb6ac49bd98934e6a2f/users/f2b6b54416cf484496d354b6e269f9af/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.911433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9303fdefbfcf4bb6ac49bd98934e6a2f, user_id=f2b6b54416cf484496d354b6e269f9af, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:56.914776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:56.927146 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:56.934019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1361/2711] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:56 2022] PUT /identity/v3/projects/9303fdefbfcf4bb6ac49bd98934e6a2f/users/f2b6b54416cf484496d354b6e269f9af/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:56.948295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:56.948733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:56.948969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:56.986956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] MFA Rules not processed for user `f2b6b54416cf484496d354b6e269f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:56.989134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:57.088068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1351/2712] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:57.096355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.196962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc9be9-0b98-4d0d-a7a2-09122624a225 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.206397 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.207044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.207361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.207661 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.208417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.211033 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.250823 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1362/2713] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:34:57 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:34:57.255408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.268888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b8207-bb0a-4052-a136-d29c0e432480 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.368756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:57.391993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.392706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.393022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.393303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.394001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.396296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.431396 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1352/2714] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:34:57 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:34:57.438928 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.460732 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352c97e-b0bc-4e46-8de6-9369d250eb93 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.467672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.468478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.468775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.469145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.469838 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.471912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.485568 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1363/2715] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:57.489999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.501971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807476fc-9477-4d11-bbab-57239fd962d5 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.506926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.507625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.507904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.508175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] PATH_INFO: `/v3/projects/491629c866d6433e97822874cb7c6157/users/9dacba48b0374688bb3b5746d6bd40f8/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.527466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=491629c866d6433e97822874cb7c6157, user_id=9dacba48b0374688bb3b5746d6bd40f8, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.531521 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.548499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1353/2716] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:57 2022] PUT /identity/v3/projects/491629c866d6433e97822874cb7c6157/users/9dacba48b0374688bb3b5746d6bd40f8/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:57.553069 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.564334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797b2af-202d-4a51-b255-0e5be5fc420c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.629433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.630164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.630598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.630941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.631747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.633619 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282863b-b746-46cf-88e4-9d3fba80ab2f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.646461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1364/2717] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:34:57.653683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.667140 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760991b0-81d5-428c-8f2e-cffa730b5b3f admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.674559 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.675245 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.675514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.675907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] PATH_INFO: `/v3/projects/491629c866d6433e97822874cb7c6157/users/9dacba48b0374688bb3b5746d6bd40f8/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.678535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491629c866d6433e97822874cb7c6157, user_id=9dacba48b0374688bb3b5746d6bd40f8, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.683997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.703969 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1354/2718] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:34:57 2022] PUT /identity/v3/projects/491629c866d6433e97822874cb7c6157/users/9dacba48b0374688bb3b5746d6bd40f8/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:34:57.723141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.724784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.725245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.761999 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] MFA Rules not processed for user `9dacba48b0374688bb3b5746d6bd40f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:34:57.763121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:57.834660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:34:57.845926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1365/2719] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:34:57.858499 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:57.861226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:57.940228 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b17c5-cc94-459b-bfbc-fb279f85a7f4 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:57.944640 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:57.945293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:57.945573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:57.945863 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:57.956951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:57.958417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:57.971615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1355/2720] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:34:58.547984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:34:58.550707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:34:58.567519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65253a4a-7e57-4070-af3b-db914e0d94e3 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:34:58.571392 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:34:58.572021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:34:58.572297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:34:58.572563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:34:58.642185 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:34:58.643586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:34:58.655389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1366/2721] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:03.237278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:03.253469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69041bd-2853-4696-9d0a-d1a195c1a04b service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:03.260221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:03.261333 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:03.261819 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:03.262293 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:03.371943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:03.375329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6fa7d-0e96-43d7-8b3e-4e5610481768 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:03.397523 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1356/2722] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:06.190492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:06.280315 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb70189-01ae-4720-91f0-131aaef414dc service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:06.287115 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:06.287861 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:06.288294 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:06.288750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] PATH_INFO: `/v3/users/94de89f26acc40e6880123965918068b` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:06.290839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94de89f26acc40e6880123965918068b)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:06.294621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:06.366089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94de89f26acc40e6880123965918068b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:06.366824 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94de89f26acc40e6880123965918068b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:06.379702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94de89f26acc40e6880123965918068b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:06.380461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94de89f26acc40e6880123965918068b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:06.393180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94de89f26acc40e6880123965918068b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:06.415618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1367/2723] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:06 2022] DELETE /identity/v3/users/94de89f26acc40e6880123965918068b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:06.420926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:06.421534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:06.421920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:06.452034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:06.454438 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:06.518626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:06.541419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1357/2724] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:06.554997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:06.556671 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:06.574577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:06.649071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595c88-f5ee-46cf-b1f6-014260e40ac5 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:06.653367 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:06.654027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:06.654313 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:06.654588 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:06.666466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:06.668220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:06.680406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1368/2725] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:07.061306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:07.062932 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:07.083296 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12096a6e-f226-4bfd-9407-6fa02df6d706 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:07.094165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:07.094165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:07.094165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:07.094165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] PATH_INFO: `/v3/projects/256903140a204ea7997cd3928bd67ad9` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:07.095117 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256903140a204ea7997cd3928bd67ad9)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:07.097120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:07.163434 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256903140a204ea7997cd3928bd67ad9', 'request_id': 'req-3cb674e8-0077-45bc-b9c3-b5131de02be8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.174026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256903140a204ea7997cd3928bd67ad9', 'request_id': 'req-3cb674e8-0077-45bc-b9c3-b5131de02be8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.181833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256903140a204ea7997cd3928bd67ad9', 'request_id': 'req-3cb674e8-0077-45bc-b9c3-b5131de02be8'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.197219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] The token cache is being invalidate because project 256903140a204ea7997cd3928bd67ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:07.197553 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.198239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.199956 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1358/2726] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:07 2022] DELETE /identity/v3/projects/256903140a204ea7997cd3928bd67ad9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:07.205166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:07.217489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbfa88-3b61-4878-9e06-eecda22c518c service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:07.277240 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:07.277869 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:07.278145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:07.278413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] PATH_INFO: `/v3/users/f2b6b54416cf484496d354b6e269f9af` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:07.280351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b6b54416cf484496d354b6e269f9af)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:07.282300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:07.336750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b6b54416cf484496d354b6e269f9af'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.337390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b6b54416cf484496d354b6e269f9af'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.346225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b6b54416cf484496d354b6e269f9af'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.346962 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b6b54416cf484496d354b6e269f9af'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.355105 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b6b54416cf484496d354b6e269f9af'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.376750 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1369/2727] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:07 2022] DELETE /identity/v3/users/f2b6b54416cf484496d354b6e269f9af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:07.677743 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:07.679200 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:07.694076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb674e8-0077-45bc-b9c3-b5131de02be8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:07.758967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:07.759951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:07.759951 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:07.760196 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] PATH_INFO: `/v3/projects/9303fdefbfcf4bb6ac49bd98934e6a2f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:07.761319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9303fdefbfcf4bb6ac49bd98934e6a2f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:07.764153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:07.824844 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9303fdefbfcf4bb6ac49bd98934e6a2f', 'request_id': 'req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.832347 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9303fdefbfcf4bb6ac49bd98934e6a2f', 'request_id': 'req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.838740 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9303fdefbfcf4bb6ac49bd98934e6a2f', 'request_id': 'req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.849793 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:07.854308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] The token cache is being invalidate because project 9303fdefbfcf4bb6ac49bd98934e6a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:07.854634 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.855341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:07.857243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1359/2728] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:07 2022] DELETE /identity/v3/projects/9303fdefbfcf4bb6ac49bd98934e6a2f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:07.862035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:07.864287 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:07.878256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b495101-5281-4a1a-ae37-17f9754a4e0f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:07.913389 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:07.943073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:07.943734 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:07.944205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:07.944391 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] PATH_INFO: `/v3/users/9dacba48b0374688bb3b5746d6bd40f8` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:07.945535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dacba48b0374688bb3b5746d6bd40f8)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:07.947478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.000384 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dacba48b0374688bb3b5746d6bd40f8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.001085 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dacba48b0374688bb3b5746d6bd40f8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.010809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dacba48b0374688bb3b5746d6bd40f8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.011575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dacba48b0374688bb3b5746d6bd40f8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.021037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-308e3e01-cd89-48ff-858c-d6159b17fd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dacba48b0374688bb3b5746d6bd40f8'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.039260 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1370/2729] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:07 2022] DELETE /identity/v3/users/9dacba48b0374688bb3b5746d6bd40f8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:08.402965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.405350 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:08.419441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac118f6b-a1f3-4bd8-916c-a1f80c696a5c admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.485782 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.486436 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.486720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.486994 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] PATH_INFO: `/v3/projects/491629c866d6433e97822874cb7c6157` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.488164 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491629c866d6433e97822874cb7c6157)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.490123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.552084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491629c866d6433e97822874cb7c6157', 'request_id': 'req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.558565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491629c866d6433e97822874cb7c6157', 'request_id': 'req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.564587 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491629c866d6433e97822874cb7c6157', 'request_id': 'req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.581338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] The token cache is being invalidate because project 491629c866d6433e97822874cb7c6157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:08.581615 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.582295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b3dd93b-4cb7-4e2d-a26d-d66546d18f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:08.583797 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1360/2730] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:08 2022] DELETE /identity/v3/projects/491629c866d6433e97822874cb7c6157 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:08.592497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.593228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.593228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.614514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:08.615878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:08.682266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1371/2731] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:08.691227 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.692124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.692124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.713765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:08.715301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:08.726146 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1361/2732] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:08.731056 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.740800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4509df8-a6f3-4414-b641-591fc776ae7b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.745450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.746076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.746352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.746625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.747262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:35:08.748114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.750039 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.763076 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1372/2733] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:35:08.768569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.785830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b034b148-a48e-4c4e-9b21-259649515a36 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.786735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.787364 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.787639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.787907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.788539 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.790501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.820943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1362/2734] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:08 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:08.825265 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.838068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8912ac7-234f-49b6-8f48-f53eb5d93a82 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.883245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:08.902333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.902942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.903216 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.903484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.904196 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.906127 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.928458 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1373/2735] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:08 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:08.933420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.946336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a47a3-0a2f-4e66-99f0-cc64d263ef86 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.952204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.952761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.952761 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.957071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.957071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.957071 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:08.967570 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1363/2736] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:08.972045 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:08.985521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d3fba-6bb7-497f-86b9-771f741b3407 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:08.990920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:08.991486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:08.991765 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:08.992051 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:08.992670 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:08.994297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8ce1-d0f8-446f-869e-45ca96d79eaa admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:09.007858 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1374/2737] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:09.012073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:09.023975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3797b7-72ba-4160-973e-7dcd700fcf00 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:09.028600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:09.029369 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:09.029768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:09.030068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] PATH_INFO: `/v3/projects/7b484ef0298742b6a05e092e6789bca3/users/1d4d4c9c26e843238a78032199a6d300/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:09.046128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b484ef0298742b6a05e092e6789bca3, user_id=1d4d4c9c26e843238a78032199a6d300, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:09.048840 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:09.063013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1364/2738] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:09 2022] PUT /identity/v3/projects/7b484ef0298742b6a05e092e6789bca3/users/1d4d4c9c26e843238a78032199a6d300/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:09.131325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:09.131604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:09.131892 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:09.165431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] MFA Rules not processed for user `1d4d4c9c26e843238a78032199a6d300`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:09.166701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:09.238776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1375/2739] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:09.251358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:09.253150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:09.298945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:09.335660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389c482-6aed-4c20-afc0-01b1b7f60fda admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:09.339595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:09.340220 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:09.340508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:09.340779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:09.361302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:09.362770 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1c7f-3179-4760-b89e-5204aa0120ec service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:09.373316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1365/2740] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:19.235381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:19.368110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=14 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:19.969551 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:20.054832 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9ec9-7e14-4353-90ae-439f48620dc0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:20.060014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:20.060777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.061111 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.061423 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] PATH_INFO: `/v3/users/1d4d4c9c26e843238a78032199a6d300` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.063427 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4d4c9c26e843238a78032199a6d300)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:20.065436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:20.130114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4d4c9c26e843238a78032199a6d300'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.130905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4d4c9c26e843238a78032199a6d300'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.143284 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4d4c9c26e843238a78032199a6d300'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.144161 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4d4c9c26e843238a78032199a6d300'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.159113 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4d4c9c26e843238a78032199a6d300'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.195567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1376/2741] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:35:19 2022] DELETE /identity/v3/users/1d4d4c9c26e843238a78032199a6d300 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:20.203252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.203641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.204092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.238011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:20.239887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.323817 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1366/2742] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:20.336151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:20.337763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.421503 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384babd5-10b7-47af-ba80-d5dedd2b82da admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:20.426393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:20.427228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.427527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.427766 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.439638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:20.441623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645af497-cbde-4dbe-bc80-bf9305d60631 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:20.454206 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1377/2743] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:20.797805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:20.800095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.826910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dc269-a90c-4340-a6dd-dd44dd3f60ad None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:20.832746 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:20.833437 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.833712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.833982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] PATH_INFO: `/v3/projects/7b484ef0298742b6a05e092e6789bca3` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.835402 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b484ef0298742b6a05e092e6789bca3)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:20.837573 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:20.901607 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b484ef0298742b6a05e092e6789bca3', 'request_id': 'req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.911742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b484ef0298742b6a05e092e6789bca3', 'request_id': 'req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.921542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b484ef0298742b6a05e092e6789bca3', 'request_id': 'req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.935230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] The token cache is being invalidate because project 7b484ef0298742b6a05e092e6789bca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:35:20.935514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.936174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-75780cfc-d48c-4cc4-8e6f-7870f6d2a773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:35:20.938256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1367/2744] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:35:20 2022] DELETE /identity/v3/projects/7b484ef0298742b6a05e092e6789bca3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:20.945975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:20.946438 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:20.946900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:20.969290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:20.970677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:20.991345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:21.053752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1378/2745] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:21.062962 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.063219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.063495 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.086360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:21.087604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:21.097142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1368/2746] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:21.101889 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.112924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc870d47-5ff8-4474-8736-1f358d8e6cab None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.117478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.118091 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.118372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.118638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.119290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:35:21.119597 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.121246 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.136645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1379/2747] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:35:21.142399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.152477 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf2855-fd64-4e79-968a-8286bf8300c4 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.159581 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.160295 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.160642 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.161099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.161665 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.163756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.194753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1369/2748] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:21.199903 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.210942 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa782-2fd1-4b2c-b601-936f2425446a admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.286855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.291974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.291974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.291974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.291974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.291974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.323641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1380/2749] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:21 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:21.328906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.342502 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03a2f8-3820-411d-bda6-4bf1ff7864ea admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.348526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.349310 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.349585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.349862 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.350528 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.352208 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.364259 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1370/2750] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:21.369741 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.391413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041e13e-677f-4a68-9e65-f34e45ff3e98 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.397225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.397853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.398320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.398603 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.399327 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.401595 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea18e37-50fa-4e8a-9e61-aab3b3f1a0d5 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.414175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1381/2751] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:21.420099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.432739 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c9d2-232c-4d3d-9c30-a3d4a5919f42 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.439070 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.440057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.440345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.440620 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] PATH_INFO: `/v3/projects/7164a2c47192420ab5c830e434b94856/users/49731e3d94d148369bac75c8e80c1208/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.462120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7164a2c47192420ab5c830e434b94856, user_id=49731e3d94d148369bac75c8e80c1208, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.464917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.480488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1371/2752] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:21 2022] PUT /identity/v3/projects/7164a2c47192420ab5c830e434b94856/users/49731e3d94d148369bac75c8e80c1208/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:35:21.487559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87aad0-2853-4dbb-b995-70bb946d0aa7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.488060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87aad0-2853-4dbb-b995-70bb946d0aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.488587 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87aad0-2853-4dbb-b995-70bb946d0aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.520749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-1d87aad0-2853-4dbb-b995-70bb946d0aa7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:21.522902 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1d87aad0-2853-4dbb-b995-70bb946d0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:21.635701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1382/2753] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:21.648963 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:21.651309 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:21.680174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:21.732652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1210-afe6-4578-8514-ae9c04e4a5e6 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:21.737424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:21.738066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:21.738343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:21.738706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:21.752244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:21.754443 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:21.769317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1372/2754] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:26.594000 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:26.594441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:26.594441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:26.629699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] MFA Rules not processed for user `49731e3d94d148369bac75c8e80c1208`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:26.631271 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:26.656499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:26.709049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1383/2755] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:26.713604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:26.725792 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f22e79-9c49-4c7b-ac33-d8e4c3d378a8 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:26.730908 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:26.731569 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:26.731809 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:26.732150 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:26.732867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:26.735368 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:26.790623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1373/2756] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:35:26 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:26.795401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:26.809648 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27dbee-24a0-4dd4-bdde-2b48e1042feb None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:26.883488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:26.884145 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:26.884663 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:26.884789 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:26.885448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:26.887579 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:26.914023 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1384/2757] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:35:26 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:35:26.918073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:26.929942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6f6c6-31aa-420b-949e-9079c109e5db admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:26.935100 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:26.935879 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:26.936159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:26.936628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:26.937365 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:26.939249 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:26.951682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1374/2758] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:26.956444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:26.967436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2344f-a65e-4960-bf3e-7d4aa2892590 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:26.973087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:26.973767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:26.974049 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:26.974328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] PATH_INFO: `/v3/projects/0f5d5da64076485da771c9dd87aece2e/users/385492c299524387a9d7fb46701c4d3f/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:26.991351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5d5da64076485da771c9dd87aece2e, user_id=385492c299524387a9d7fb46701c4d3f, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:26.994097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:27.010275 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1385/2759] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:26 2022] PUT /identity/v3/projects/0f5d5da64076485da771c9dd87aece2e/users/385492c299524387a9d7fb46701c4d3f/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:27.016217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:27.027317 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a99482-cee6-495f-ad46-b726776390c4 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:27.093578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:27.094595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:27.095076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:27.095547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:27.096432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:27.098303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539f85f-21ee-4716-bc78-eacc295dc4dc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:27.110449 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1375/2760] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:35:27.114254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:27.126507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885f751-80da-42ec-9a80-85a1d6afca64 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:27.131981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:27.132656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:27.132991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:27.133264 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] PATH_INFO: `/v3/projects/0f5d5da64076485da771c9dd87aece2e/users/385492c299524387a9d7fb46701c4d3f/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:27.135229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5d5da64076485da771c9dd87aece2e, user_id=385492c299524387a9d7fb46701c4d3f, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:27.138301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:27.150370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1386/2761] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:35:27 2022] PUT /identity/v3/projects/0f5d5da64076485da771c9dd87aece2e/users/385492c299524387a9d7fb46701c4d3f/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:35:32.267373 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76900fd-66c6-4860-b972-68f60c7b6067 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.268092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76900fd-66c6-4860-b972-68f60c7b6067 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.268092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76900fd-66c6-4860-b972-68f60c7b6067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.311725 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-e76900fd-66c6-4860-b972-68f60c7b6067 None None] MFA Rules not processed for user `385492c299524387a9d7fb46701c4d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:32.314000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-e76900fd-66c6-4860-b972-68f60c7b6067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.413978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1376/2762] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:35:32.434598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:32.438193 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.559238 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2720a-e866-4355-a0d0-cdeaa25d0b67 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:32.563297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d8c7621f2a472ca879b60d7340edc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:32.564229 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.564372 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.564612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.569673 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:32.641882 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:32.643924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:32.657582 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1387/2763] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:32.833748 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5bf2-bcbc-4487-b5cf-07bf4ccff76e None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:32.834132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5bf2-bcbc-4487-b5cf-07bf4ccff76e None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:32.834525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5bf2-bcbc-4487-b5cf-07bf4ccff76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:32.859683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:32.915358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-7f5f5bf2-bcbc-4487-b5cf-07bf4ccff76e None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:32.916585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-7f5f5bf2-bcbc-4487-b5cf-07bf4ccff76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:32.995118 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1377/2764] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:35:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:33.057820 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:33.059269 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:33.187515 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bb2a8-3504-443f-ae14-27328c116055 service glance] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:33.200771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:33.201525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:33.201866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:33.202743 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:33.212745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:33.214402 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:33.227498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1388/2765] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:35:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:35:39.999768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:40.000660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:40.000660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:40.027776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] MFA Rules not processed for user `017f19fdb79140ab9785acb65b20f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:40.029142 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:40.134534 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1378/2766] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:40.570786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:40.572286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:40.648349 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2137378-c194-403c-b855-47d6ff05ef45 service swift] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:40.652453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:40.653155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:40.653459 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:40.653785 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:40.657875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:40.671960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:40.673525 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea785c-fc11-4bfe-8ec2-071257d49540 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:40.682872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1389/2767] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:41.108902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:41.111544 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.220359 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5966f-c14e-4801-b8e1-3c51cd10bddc None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:41.225637 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:41.226302 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:41.226603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:41.228417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:41.230866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:41.243680 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:41.245689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:41.259243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1379/2768] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:35:44.054433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d98c5-6333-426e-9256-580123b4f72d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:44.055057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d98c5-6333-426e-9256-580123b4f72d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:44.055057 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d98c5-6333-426e-9256-580123b4f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:44.076120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-971d98c5-6333-426e-9256-580123b4f72d None None] MFA Rules not processed for user `49731e3d94d148369bac75c8e80c1208`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:44.077573 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-971d98c5-6333-426e-9256-580123b4f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:44.085032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1390/2769] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:35:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:46.605852 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:46.607576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:46.632171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:46.711504 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0379e-c72f-4761-8624-6c308ad67e3d service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:46.718735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:46.720211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:46.720529 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:46.720992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:46.725170 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:46.752781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:46.754839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:46.776065 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1380/2770] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:35:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:35:46.793106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:46.794268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:46.794722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:46.824344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:35:46.825677 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:35:46.834986 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1391/2771] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:35:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:35:46.850618 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:35:46.864741 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6756fa-7d60-4286-a42e-a43a9a61e143 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:35:46.870399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:35:46.871045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:35:46.871324 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:35:46.871624 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:35:46.885153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:35:46.886657 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:35:46.897257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1381/2772] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:35:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:35:56.817572 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:35:56.893427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=32 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:05.790729 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:05.792414 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:05.812745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedb517-f075-4038-8db5-28e54bc01bc7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:05.819415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:05.820060 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:05.820351 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:05.820600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:05.822694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:05.837638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:05.839290 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:05.852549 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1392/2773] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:11.836156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:11.853341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75962cf5-6de3-4667-af90-2b7be6a48b1f service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:11.861507 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:11.862444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:11.862779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:11.863267 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:11.866128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:36:11.886041 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:11.887903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:11.905696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1382/2774] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:15.847589 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:18.267456 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:36:18.278128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870fe50-7a72-4a86-9a94-be3a76d97c38 service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:36:18.283088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:36:18.283877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:36:18.284352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:36:18.284684 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:36:18.295296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:36:18.297543 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e517d5-eade-42a7-8a3d-3b7f8013123a service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:36:18.308337 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1393/2775] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:36:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:36:21.897928 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=6 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:36:28.303612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:45.225238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:45.250174 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda8e78-ea03-4f0c-aae8-140120dd9737 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:45.259004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:45.259656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:45.259974 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:45.260358 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:45.262675 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:45.283834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:45.297256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:45.327049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1383/2776] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:37:55.313526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=6 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:37:56.509694 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:56.510795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:56.510795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:56.531032 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] MFA Rules not processed for user `017f19fdb79140ab9785acb65b20f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:37:56.532262 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:56.539527 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1394/2777] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:37:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:37:56.864419 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:37:56.873923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19330c74-fca1-42a0-9047-cddcf48a9403 service placement] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:37:56.878338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:37:56.879022 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:37:56.879225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:37:56.879488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:37:56.881377 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:37:56.891686 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:37:56.893291 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:37:56.902264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1384/2778] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:37:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:38:06.525175 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:38:06.898353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=6 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:11.226373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:11.236883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f5600-9c2e-49c3-961a-fc935d031f82 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:11.240457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:11.241154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:11.241432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:11.241700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:11.243900 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:11.258890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:11.260457 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91f72-6c58-4e82-a912-6320b112f675 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:11.271774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1395/2779] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:17.266184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:17.274945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7666f9-0841-4220-b74e-1c6bc0280d32 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:17.279059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:17.279659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:17.279939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:17.280206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:17.281995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:17.297498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:17.298949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:17.310886 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1385/2780] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:19.808012 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214523-221a-4547-bfee-45385e304b81 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:19.809190 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214523-221a-4547-bfee-45385e304b81 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:19.809288 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214523-221a-4547-bfee-45385e304b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:19.829624 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-6c214523-221a-4547-bfee-45385e304b81 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:39:19.830845 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6c214523-221a-4547-bfee-45385e304b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:19.838268 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1396/2781] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:39:19.880049 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:19.891968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64aa01-c470-4562-b3aa-c9feb842ad65 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:19.897195 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:19.897804 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:19.898083 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:19.898354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:19.907126 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:19.908699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:19.916586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1386/2782] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:39:23.424837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214523-221a-4547-bfee-45385e304b81 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:23.426297 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-6c214523-221a-4547-bfee-45385e304b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:23.442640 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214523-221a-4547-bfee-45385e304b81 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:23.448795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:23.449446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:23.449724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:23.449991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:23.451731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:23.464537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:23.466197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:23.481883 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1397/2783] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:39:26.473269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:26.543781 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062c45d-7531-400c-904c-64b6679a9947 service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:26.548427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:26.549703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:26.549953 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:26.550225 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] PATH_INFO: `/v3/users/49731e3d94d148369bac75c8e80c1208` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:26.551717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49731e3d94d148369bac75c8e80c1208)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:26.553776 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:26.601616 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49731e3d94d148369bac75c8e80c1208'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.614043 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49731e3d94d148369bac75c8e80c1208'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.621353 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49731e3d94d148369bac75c8e80c1208'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.622097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49731e3d94d148369bac75c8e80c1208'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.622707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49731e3d94d148369bac75c8e80c1208'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.635632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1387/2784] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:39:26 2022] DELETE /identity/v3/users/49731e3d94d148369bac75c8e80c1208 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:39:26.830114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:26.841034 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1d16-8252-4cc8-949e-22bfb69f3cd0 service placement] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:26.908152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:26.908871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:26.909154 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:26.909426 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] PATH_INFO: `/v3/projects/7164a2c47192420ab5c830e434b94856` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:26.910591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] RBAC: Authorizing `identity:delete_project(project_id=7164a2c47192420ab5c830e434b94856)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:26.913228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:26.968021 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7164a2c47192420ab5c830e434b94856', 'request_id': 'req-147976a4-35e9-4ab0-8832-dcfebf6cecac'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.976151 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7164a2c47192420ab5c830e434b94856', 'request_id': 'req-147976a4-35e9-4ab0-8832-dcfebf6cecac'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.982638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7164a2c47192420ab5c830e434b94856', 'request_id': 'req-147976a4-35e9-4ab0-8832-dcfebf6cecac'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.994983 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] The token cache is being invalidate because project 7164a2c47192420ab5c830e434b94856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:39:26.995283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.996536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:26.998328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1398/2785] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:39:26 2022] DELETE /identity/v3/projects/7164a2c47192420ab5c830e434b94856 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:39:27.002376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:27.003875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:27.017700 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db1a77-2dcd-4db8-9a5d-2e7c989aa524 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:27.068867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:27.082087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:27.082822 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:27.083282 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:27.083557 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] PATH_INFO: `/v3/users/385492c299524387a9d7fb46701c4d3f` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:27.084719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385492c299524387a9d7fb46701c4d3f)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:27.086881 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:27.138064 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385492c299524387a9d7fb46701c4d3f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.155734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385492c299524387a9d7fb46701c4d3f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.162952 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385492c299524387a9d7fb46701c4d3f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.163625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385492c299524387a9d7fb46701c4d3f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.164226 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385492c299524387a9d7fb46701c4d3f'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.178719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1388/2786] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:39:27 2022] DELETE /identity/v3/users/385492c299524387a9d7fb46701c4d3f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:39:27.353977 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:27.355523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:27.379653 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147976a4-35e9-4ab0-8832-dcfebf6cecac admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:27.434984 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:27.442585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:27.443646 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:27.444166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:27.444542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] PATH_INFO: `/v3/projects/0f5d5da64076485da771c9dd87aece2e` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:27.445937 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5d5da64076485da771c9dd87aece2e)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:27.448165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:27.498286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5d5da64076485da771c9dd87aece2e', 'request_id': 'req-eefba375-5731-42c3-8cab-ac1bb55dcc10'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.505830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5d5da64076485da771c9dd87aece2e', 'request_id': 'req-eefba375-5731-42c3-8cab-ac1bb55dcc10'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.513090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5d5da64076485da771c9dd87aece2e', 'request_id': 'req-eefba375-5731-42c3-8cab-ac1bb55dcc10'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.523415 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] The token cache is being invalidate because project 0f5d5da64076485da771c9dd87aece2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:39:27.523697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.524355 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-eefba375-5731-42c3-8cab-ac1bb55dcc10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:39:27.525852 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1399/2787] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:39:27 2022] DELETE /identity/v3/projects/0f5d5da64076485da771c9dd87aece2e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:39:37.175177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:37.520431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:40.115600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:40.117165 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:40.197404 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576500b1-65cd-4297-a194-53e6dad71421 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:40.260571 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:40.261202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:40.261478 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:40.261745 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:40.263496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:40.323371 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:40.324990 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:40.334271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1389/2788] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:39:50.330264 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=84 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:39:52.835006 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:52.835574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:52.835574 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:52.856933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] MFA Rules not processed for user `017f19fdb79140ab9785acb65b20f1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:39:52.858128 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:52.865052 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1400/2789] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:39:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:39:55.351927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:39:55.353445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:55.422512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86661439-5182-4ec5-b1e5-a21eeb9bbd6a service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:39:55.426563 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:39:55.427186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:39:55.427458 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:39:55.427723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:39:55.429512 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:39:55.440796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:39:55.442308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:39:55.450959 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1390/2790] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:39:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:40:02.851208 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:40:05.447825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=26 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:30.244205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:30.245887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:30.339494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21ed41-207d-49a7-a0f5-43507591dad0 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:30.346126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:30.346786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:30.347047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:30.347322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:30.349333 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:30.363263 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:30.365141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:30.379330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1401/2791] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:35.256586 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:35.293628 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb642891-4451-40f5-9516-07a57a76ae02 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:35.297338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:35.297913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:35.298188 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:35.298455 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:35.300206 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:35.386337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:35.387786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:35.408204 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1391/2792] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:38.673180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:38.674688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:38.696095 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d15537-3bcb-41fc-b075-e8e19d44767f service nova] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:38.702126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:38.702755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:38.703040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:38.703301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] PATH_INFO: `/v3/users/017f19fdb79140ab9785acb65b20f1eb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:38.704412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=017f19fdb79140ab9785acb65b20f1eb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:38.706364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:38.756159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017f19fdb79140ab9785acb65b20f1eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:38.756782 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017f19fdb79140ab9785acb65b20f1eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:38.764799 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017f19fdb79140ab9785acb65b20f1eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:38.765505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017f19fdb79140ab9785acb65b20f1eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:38.773197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1dd57267-d9d9-469b-859c-581a99fa2e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017f19fdb79140ab9785acb65b20f1eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:38.791963 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1402/2793] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:38 2022] DELETE /identity/v3/users/017f19fdb79140ab9785acb65b20f1eb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:38.974810 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:38.987315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3974556-30b5-4963-99a5-6224db6e5874 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.047921 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.048466 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.048742 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.049044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] PATH_INFO: `/v3/projects/dd3cb603326f41ffa59b7ca57408f390` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.050181 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3cb603326f41ffa59b7ca57408f390)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.052102 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.094896 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:39.102176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3cb603326f41ffa59b7ca57408f390', 'request_id': 'req-499933c0-00fa-4430-b39a-c355db24edb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:39.109671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3cb603326f41ffa59b7ca57408f390', 'request_id': 'req-499933c0-00fa-4430-b39a-c355db24edb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:39.115376 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3cb603326f41ffa59b7ca57408f390', 'request_id': 'req-499933c0-00fa-4430-b39a-c355db24edb5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:39.127900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] The token cache is being invalidate because project dd3cb603326f41ffa59b7ca57408f390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:39.128207 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:39.128892 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-499933c0-00fa-4430-b39a-c355db24edb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:39.130375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1392/2794] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:38 2022] DELETE /identity/v3/projects/dd3cb603326f41ffa59b7ca57408f390 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:39.135363 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.135650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.135929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.164675 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:39.165907 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:39.226223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1403/2795] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:39.234595 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.234878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.235153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.255979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:39.257215 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:39.265201 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1393/2796] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:39.269466 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.275954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:39.280107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd793d7a-50c8-486c-b6c6-cc8e6fc04e1f None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.286094 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107052-3667-4975-af47-be29f6549984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.286873 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107052-3667-4975-af47-be29f6549984 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.287325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107052-3667-4975-af47-be29f6549984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.287650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107052-3667-4975-af47-be29f6549984 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.288484 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41107052-3667-4975-af47-be29f6549984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:41:39.288795 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41107052-3667-4975-af47-be29f6549984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.290413 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41107052-3667-4975-af47-be29f6549984 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.303046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1404/2797] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:41:39.307522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.317143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b5b11-380d-4847-ac8f-75f7f96c1dab None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.322002 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.322694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.323006 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.323233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.323864 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.325802 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.352979 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1394/2798] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:39.357702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107052-3667-4975-af47-be29f6549984 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.368106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107052-3667-4975-af47-be29f6549984 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.429087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.429702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.429980 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.430250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.430881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.433022 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.455181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1405/2799] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:39.459306 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.471349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07bb8e-d17c-4fc8-90db-5f1dd9073456 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.476068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.476706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.477026 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.477298 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.477949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.479550 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.491905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1395/2800] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:39.496197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.506712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c2d8a-301b-403d-ba8b-1dffeeeaca9d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.513461 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.514067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.514343 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.514618 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.515253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.516929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b2259-c6a3-40a6-bd9c-bb0bb411a02b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.528731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1406/2801] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:39.533175 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.543417 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31b815-9425-40e2-a212-f04d2a2d641d admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.547975 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.548632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.548945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.549219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] PATH_INFO: `/v3/projects/4c3708bbc5b046ca8b9754fe5bb0cece/users/b6ea6b514e074ba7943855e56f8d36eb/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.564067 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3708bbc5b046ca8b9754fe5bb0cece, user_id=b6ea6b514e074ba7943855e56f8d36eb, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.566713 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.580134 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1396/2802] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:39 2022] PUT /identity/v3/projects/4c3708bbc5b046ca8b9754fe5bb0cece/users/b6ea6b514e074ba7943855e56f8d36eb/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:39.592202 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.592483 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.592755 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.620422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] MFA Rules not processed for user `b6ea6b514e074ba7943855e56f8d36eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:39.621652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:39.690473 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1407/2803] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:39.695304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.765656 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579962a2-9c0f-45b7-b785-0cec6fd3ad6c admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.771719 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.772345 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.772625 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.772937 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.773584 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.775508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.805903 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1397/2804] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/projects => generated 399 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:39.811067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.823564 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc238cee-bc9a-45e8-9bbf-e80fd7daef07 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.879954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.880565 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.880881 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.881163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.881821 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.883731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.891616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:39.908053 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1408/2805] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:39 2022] POST /identity/v3/users => generated 306 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:39.911691 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.923629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57c113-aab7-47ae-a8ca-4c947bd19385 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.928330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.928981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.929261 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.929535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.930210 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.931805 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.943929 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1398/2806] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:41:39.948470 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:39.958645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f75cc-8bd4-4756-86d0-82bcd19bdff6 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:39.964291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:39.964922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:39.965203 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:39.965478 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] PATH_INFO: `/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963/users/8684e6d81083492a84822143ec8b42b3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:39.981519 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7df68dfbf704d3ab34ba8c8d1fa0963, user_id=8684e6d81083492a84822143ec8b42b3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:39.984225 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:39.997989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1409/2807] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:39 2022] PUT /identity/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963/users/8684e6d81083492a84822143ec8b42b3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:40.002010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:40.013243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a1254-6953-4020-9435-9d24bc5aa248 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:40.052242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:40.072689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:40.073343 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:40.073623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:40.073900 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:40.074547 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:40.076176 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2bef7-70ae-4e66-8142-111fdffa1645 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:40.086172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1399/2808] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:40.091131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:40.101482 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792ef2-573a-4d4f-9720-bb7571d0e989 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:40.107197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:40.107860 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:40.108142 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:40.108412 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] PATH_INFO: `/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963/users/8684e6d81083492a84822143ec8b42b3/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:40.110430 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7df68dfbf704d3ab34ba8c8d1fa0963, user_id=8684e6d81083492a84822143ec8b42b3, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:40.113114 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:40.123787 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1410/2809] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:40 2022] PUT /identity/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963/users/8684e6d81083492a84822143ec8b42b3/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:40.134053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:40.134338 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:40.134609 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:40.175696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] MFA Rules not processed for user `8684e6d81083492a84822143ec8b42b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:40.176949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:40.246032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1400/2810] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:40 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:40.257672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:40.259406 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:40.341975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b980dd-ced3-4045-bbbf-190f4f8ac698 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:40.345528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:40.346122 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:40.346393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:40.346659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:40.355731 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:40.357179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:40.366511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1411/2811] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:40.444276 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:40.454445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bbf22-d000-49fb-a2e3-51d088797750 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:40.458007 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:40.458604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:40.458885 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:40.459156 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:40.522565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:40.524017 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dead75-d9f1-4d6f-811a-191dfbf9b7eb service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:40.533833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1401/2812] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:40 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:44.629777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:44.695133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c54d-05cc-45e8-a770-126e6f9af669 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:44.700220 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:44.700890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:44.701165 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:44.701433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] PATH_INFO: `/v3/users/b6ea6b514e074ba7943855e56f8d36eb` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:44.702542 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ea6b514e074ba7943855e56f8d36eb)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:44.704453 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:44.743718 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:44.753887 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ea6b514e074ba7943855e56f8d36eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:44.754711 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ea6b514e074ba7943855e56f8d36eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:44.763121 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ea6b514e074ba7943855e56f8d36eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:44.763776 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ea6b514e074ba7943855e56f8d36eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:44.771239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ea6b514e074ba7943855e56f8d36eb'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:44.789932 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1412/2813] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:44 2022] DELETE /identity/v3/users/b6ea6b514e074ba7943855e56f8d36eb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:44.794650 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:44.795168 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:44.795281 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:44.814922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:44.816184 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:44.868707 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:44.877661 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1402/2814] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:44.889097 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:44.890511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:44.962253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e92c45-aee2-4ed9-b767-1d4b856d976c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:44.966536 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:44.967141 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:44.967417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:44.967688 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:44.977133 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:44.978777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:44.988437 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1413/2815] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:45.258124 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:45.259655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:45.272073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1ff60-a208-4a0c-b23f-cca89ffb413c None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:45.277448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:45.278141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:45.278405 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:45.278815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] PATH_INFO: `/v3/projects/4c3708bbc5b046ca8b9754fe5bb0cece` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:45.279978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3708bbc5b046ca8b9754fe5bb0cece)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:45.281942 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:45.330444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3708bbc5b046ca8b9754fe5bb0cece', 'request_id': 'req-06292f04-24c5-4bf5-8514-63461452e630'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.336682 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3708bbc5b046ca8b9754fe5bb0cece', 'request_id': 'req-06292f04-24c5-4bf5-8514-63461452e630'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.343045 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3708bbc5b046ca8b9754fe5bb0cece', 'request_id': 'req-06292f04-24c5-4bf5-8514-63461452e630'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.356690 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] The token cache is being invalidate because project 4c3708bbc5b046ca8b9754fe5bb0cece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:45.357011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.357645 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.359171 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1403/2816] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:45 2022] DELETE /identity/v3/projects/4c3708bbc5b046ca8b9754fe5bb0cece => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:45.363662 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:45.374641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6a27f-35ed-4ddf-83c8-7acd67d18002 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:45.431361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:45.432087 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:45.432362 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:45.432625 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] PATH_INFO: `/v3/users/8684e6d81083492a84822143ec8b42b3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:45.433792 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8684e6d81083492a84822143ec8b42b3)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:45.435730 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:45.482649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8684e6d81083492a84822143ec8b42b3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.483325 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8684e6d81083492a84822143ec8b42b3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.485040 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:45.491855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8684e6d81083492a84822143ec8b42b3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.493088 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8684e6d81083492a84822143ec8b42b3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.500981 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-a50d32e6-feb3-4610-9c05-866f21e1fd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8684e6d81083492a84822143ec8b42b3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.518550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1414/2817] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:45 2022] DELETE /identity/v3/users/8684e6d81083492a84822143ec8b42b3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:45.803132 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:45.804683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:45.818985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06292f04-24c5-4bf5-8514-63461452e630 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:45.883068 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:45.883695 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:45.883978 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:45.884243 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] PATH_INFO: `/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:45.886576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7df68dfbf704d3ab34ba8c8d1fa0963)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:45.888484 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:45.944583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7df68dfbf704d3ab34ba8c8d1fa0963', 'request_id': 'req-8ab2307c-e305-4ba0-9775-e5cec3b57246'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.952087 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7df68dfbf704d3ab34ba8c8d1fa0963', 'request_id': 'req-8ab2307c-e305-4ba0-9775-e5cec3b57246'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.957796 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7df68dfbf704d3ab34ba8c8d1fa0963', 'request_id': 'req-8ab2307c-e305-4ba0-9775-e5cec3b57246'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.970423 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] The token cache is being invalidate because project d7df68dfbf704d3ab34ba8c8d1fa0963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:45.970706 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.971327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-8ab2307c-e305-4ba0-9775-e5cec3b57246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:45.972965 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1404/2818] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:45 2022] DELETE /identity/v3/projects/d7df68dfbf704d3ab34ba8c8d1fa0963 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:45.977817 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:45.978324 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:45.978422 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:45.998159 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:45.999528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:46.060702 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1415/2819] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:46.068652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.068970 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.069250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.089893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:46.091099 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:46.099051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1405/2820] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:46.103381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.113380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a71ae2-cd35-4096-b50a-a3cde8910330 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.117936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.118537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.118812 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.119606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.120332 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:41:46.120633 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.122257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.134276 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1416/2821] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:41:46.139382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.148756 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f15a98-ceba-4a40-834c-e6e862b97f2f None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.153876 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.154488 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.154767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.155037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.155689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.157623 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.162260 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:46.188996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1406/2822] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:46.193936 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.204796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602218b-237f-452e-a07f-af65d181ff46 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.277712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.278322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.278599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.278875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.279511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.281498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.304752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1417/2823] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/users => generated 305 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:41:46.309474 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.320357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acce32-30ed-46a1-8ddd-c5c66b9c119b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.325095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.325702 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.325982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.326257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.326907 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.328516 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.339078 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1407/2824] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:46.343561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.354236 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0037838-fa07-4e68-a119-a72a6e5638ca admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.358837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.359463 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.359738 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.360007 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.360639 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.362251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8626b-ecfe-4c11-9fa2-c00f25cb5b11 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.373446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1418/2825] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:46.377865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.388038 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190fcc0-b0ea-426d-8d70-4a195c61c9db admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.392723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.393475 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.393753 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.394027 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] PATH_INFO: `/v3/projects/1eed3a6aa4dd4f5f8f0e1d221354b259/users/d4f4cb7efcf44913a3680e4e7fe645e5/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.410888 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eed3a6aa4dd4f5f8f0e1d221354b259, user_id=d4f4cb7efcf44913a3680e4e7fe645e5, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.413588 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.428037 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1408/2826] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:46 2022] PUT /identity/v3/projects/1eed3a6aa4dd4f5f8f0e1d221354b259/users/d4f4cb7efcf44913a3680e4e7fe645e5/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:46.440253 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.440528 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.440796 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.468613 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] MFA Rules not processed for user `d4f4cb7efcf44913a3680e4e7fe645e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:46.469855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:46.490598 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:46.539321 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1419/2827] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:46.544457 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.609535 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774fd14-f52a-44b8-a257-8670426ce536 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.613790 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.614392 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.614671 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.614940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.615558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.617494 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.644328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1409/2828] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/projects => generated 407 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:46.648632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.661092 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fe5cc-806c-4622-9e95-759deed21f86 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.724853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.725511 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.725746 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.726013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.726725 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.728632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.751651 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1420/2829] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/users => generated 310 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:46.755629 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.766444 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd429499-ad40-4fe8-8da6-7fbef01ca598 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.771760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.772612 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.772920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.773202 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.773887 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.775600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.788789 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1410/2830] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:46.793388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.803697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0f6b4-ab98-436f-b736-022c6441b84c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.808839 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.809498 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.809774 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.810046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] PATH_INFO: `/v3/projects/9a8b39de94334a32a25e17ee7197d954/users/ca354c00e65b44e4869b3cc3ec3cf838/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.828432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b39de94334a32a25e17ee7197d954, user_id=ca354c00e65b44e4869b3cc3ec3cf838, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.831851 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.845877 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1421/2831] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:46 2022] PUT /identity/v3/projects/9a8b39de94334a32a25e17ee7197d954/users/ca354c00e65b44e4869b3cc3ec3cf838/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:46.850010 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.861433 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a360a-b5a6-4a68-844f-5c8b324e2796 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.919639 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.920253 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.920530 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.920825 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.921592 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.923238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a20ce6-c300-47d1-bb08-546415049f3b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.933927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1411/2832] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:46.938472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:46.949514 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da4fc4-3e60-467e-bee6-a0af98929183 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:46.954232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:46.954872 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.955148 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.955450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] PATH_INFO: `/v3/projects/9a8b39de94334a32a25e17ee7197d954/users/ca354c00e65b44e4869b3cc3ec3cf838/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:46.957418 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8b39de94334a32a25e17ee7197d954, user_id=ca354c00e65b44e4869b3cc3ec3cf838, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:46.960047 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:46.971336 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1422/2833] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:46 2022] PUT /identity/v3/projects/9a8b39de94334a32a25e17ee7197d954/users/ca354c00e65b44e4869b3cc3ec3cf838/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:46.981871 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:46.982159 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:46.982435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:47.011660 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] MFA Rules not processed for user `ca354c00e65b44e4869b3cc3ec3cf838`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:47.013108 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:47.022236 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:47.085764 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1412/2834] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:46 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:47.097371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:47.099188 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:47.157681 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bd3e2-594a-4cf5-a92d-9e1c28f82d34 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:47.161298 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:47.161899 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:47.162177 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:47.162448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:47.172602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:47.174071 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:47.184381 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1423/2835] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:47.346205 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:47.355866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07abb9a-20c1-40eb-8e46-07c45407ff19 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:47.359759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:47.360490 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:47.360867 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:47.361094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:47.426096 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:47.427558 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892e803-728c-462a-bb31-590bc61f3f92 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:47.436931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1413/2836] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:52.748865 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:52.766003 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:52.813736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2339a-1c7c-46ec-8e4f-fb75dc4d9160 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:52.818308 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:52.818944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:52.819218 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:52.819486 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] PATH_INFO: `/v3/users/d4f4cb7efcf44913a3680e4e7fe645e5` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:52.820623 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f4cb7efcf44913a3680e4e7fe645e5)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:52.822586 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:52.871316 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f4cb7efcf44913a3680e4e7fe645e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:52.872070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f4cb7efcf44913a3680e4e7fe645e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:52.880035 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f4cb7efcf44913a3680e4e7fe645e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:52.880784 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f4cb7efcf44913a3680e4e7fe645e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:52.888364 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f4cb7efcf44913a3680e4e7fe645e5'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:52.905492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1424/2837] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:52 2022] DELETE /identity/v3/users/d4f4cb7efcf44913a3680e4e7fe645e5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:52.909982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:52.910508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:52.910508 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:52.929778 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:52.930982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:52.990329 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1414/2838] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:53.001180 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:53.002606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:53.061990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c3347-6f2f-433f-a070-46aba0ec4e61 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:53.065627 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:53.066228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:53.066505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:53.066777 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:53.075961 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:53.077436 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:53.086947 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1425/2839] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:53.365211 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:53.366924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:53.382221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029ae36-a08e-4d0b-a2c4-5e25ae71c5c7 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:53.387940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:53.388600 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:53.388904 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:53.389187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] PATH_INFO: `/v3/projects/1eed3a6aa4dd4f5f8f0e1d221354b259` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:53.390393 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eed3a6aa4dd4f5f8f0e1d221354b259)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:53.392319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:53.438250 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:53.445755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eed3a6aa4dd4f5f8f0e1d221354b259', 'request_id': 'req-3ac1e6db-faf0-4226-a989-1bb6dca833ab'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.452894 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eed3a6aa4dd4f5f8f0e1d221354b259', 'request_id': 'req-3ac1e6db-faf0-4226-a989-1bb6dca833ab'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.458506 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eed3a6aa4dd4f5f8f0e1d221354b259', 'request_id': 'req-3ac1e6db-faf0-4226-a989-1bb6dca833ab'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.471603 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] The token cache is being invalidate because project 1eed3a6aa4dd4f5f8f0e1d221354b259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:53.471893 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.472525 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.474030 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1415/2840] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:53 2022] DELETE /identity/v3/projects/1eed3a6aa4dd4f5f8f0e1d221354b259 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:53.477994 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:53.487751 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e3791-8f09-47a9-b34d-7954b2a9b068 service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:53.522747 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:53.547472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:53.548099 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:53.548374 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:53.548644 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] PATH_INFO: `/v3/users/ca354c00e65b44e4869b3cc3ec3cf838` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:53.549779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca354c00e65b44e4869b3cc3ec3cf838)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:53.551697 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:53.599450 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca354c00e65b44e4869b3cc3ec3cf838'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.600183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca354c00e65b44e4869b3cc3ec3cf838'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.607912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca354c00e65b44e4869b3cc3ec3cf838'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.608739 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca354c00e65b44e4869b3cc3ec3cf838'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.616604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cbbecac0-4fd9-4474-8e86-0e03c04fd005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca354c00e65b44e4869b3cc3ec3cf838'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:53.634606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1426/2841] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:53 2022] DELETE /identity/v3/users/ca354c00e65b44e4869b3cc3ec3cf838 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:53.917828 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:53.919597 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:53.936566 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1e6db-faf0-4226-a989-1bb6dca833ab admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:53.996870 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:53.997552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:53.997833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:53.998110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] PATH_INFO: `/v3/projects/9a8b39de94334a32a25e17ee7197d954` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:53.999271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8b39de94334a32a25e17ee7197d954)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.001238 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.051602 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8b39de94334a32a25e17ee7197d954', 'request_id': 'req-9b6eab38-5015-400e-83e9-b20b50adf823'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.057765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8b39de94334a32a25e17ee7197d954', 'request_id': 'req-9b6eab38-5015-400e-83e9-b20b50adf823'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.063998 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8b39de94334a32a25e17ee7197d954', 'request_id': 'req-9b6eab38-5015-400e-83e9-b20b50adf823'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.077697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] The token cache is being invalidate because project 9a8b39de94334a32a25e17ee7197d954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:54.077983 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.078699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9b6eab38-5015-400e-83e9-b20b50adf823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.080230 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1416/2842] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:53 2022] DELETE /identity/v3/projects/9a8b39de94334a32a25e17ee7197d954 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:54.085239 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.085793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.085793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.107365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:54.108567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:54.169443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1427/2843] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:54.178148 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.178435 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.178714 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.199923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:54.201186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:54.210058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1417/2844] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:54.213700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.224213 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b15d9-c929-40f4-8c9e-8ee614a302d7 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.229073 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.230638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.231065 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.231344 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.231993 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:41:54.232853 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.233966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.246371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1428/2845] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:41:54.250859 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.260357 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b4f56-dc12-4fa4-9915-9853c962ed80 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.265169 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.265780 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.266059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.266325 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.266955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.268905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.297868 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1418/2846] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:54.302232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.312532 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51129145-bcdc-4eee-8baa-fe20566f40fd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.354951 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:54.371849 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.372492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.372772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.373072 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.373712 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.375629 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.396813 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1429/2847] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:54.400981 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.412141 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0e026-f49c-4bce-a908-eb404447c546 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.417058 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.417774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.418047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.418312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.419048 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.420878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.431866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1419/2848] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:54.436424 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.447283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee197b52-a6c9-49b7-943d-e2566dabc7bd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.452494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.453205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.453485 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.453790 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.454448 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.456046 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0a74c-4c89-4ca3-b119-8f44c49760b6 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.468834 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1430/2849] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:41:54.473187 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.483808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031361-3172-4cc1-bb61-7200dcb2f4ac admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.490073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.490754 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.491044 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.491316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] PATH_INFO: `/v3/projects/05c72e5279434669aae119abe832668d/users/1c8b42133da34a66a4c1dc4ca78655d3/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.507429 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c72e5279434669aae119abe832668d, user_id=1c8b42133da34a66a4c1dc4ca78655d3, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.510292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.513418 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:54.526382 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1420/2850] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:54 2022] PUT /identity/v3/projects/05c72e5279434669aae119abe832668d/users/1c8b42133da34a66a4c1dc4ca78655d3/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:54.538075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.538382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.538652 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.566212 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] MFA Rules not processed for user `1c8b42133da34a66a4c1dc4ca78655d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:54.567320 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:54.631138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1431/2851] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:54.642735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.644432 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:54.703902 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d9e17-b70b-42c9-9e83-b9a3d446b994 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.707568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.708179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.708456 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.708726 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.717996 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.719431 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf44fa-f5ee-4fb9-b9c8-99f149e9a32c service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.728985 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1421/2852] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:54.748610 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:54.814031 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791f2f0-0b4c-45a4-9cbb-fdaaea04d2a8 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:54.818836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:54.819420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.819700 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.819976 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] PATH_INFO: `/v3/users/1c8b42133da34a66a4c1dc4ca78655d3` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.821157 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c8b42133da34a66a4c1dc4ca78655d3)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:54.823136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:54.870061 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c8b42133da34a66a4c1dc4ca78655d3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.872138 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c8b42133da34a66a4c1dc4ca78655d3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.878798 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c8b42133da34a66a4c1dc4ca78655d3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.879524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c8b42133da34a66a4c1dc4ca78655d3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.880958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:54.889334 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c8b42133da34a66a4c1dc4ca78655d3'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:54.906837 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1432/2853] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:41:54 2022] DELETE /identity/v3/users/1c8b42133da34a66a4c1dc4ca78655d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:54.911319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:54.911606 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:54.911878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:54.930944 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:54.932143 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:54.993960 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1422/2854] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:55.003901 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.005345 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:55.064228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebad8b2-2f35-4dbd-9bdf-4a77ccd1c56d admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.067878 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.068477 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.068753 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.069100 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.078170 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.079592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543fe9f-97a4-4397-9af6-8f6f49897a12 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.089704 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1433/2855] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:41:55.363832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.365424 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:55.377853 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20923cee-a94f-4bb8-8b54-a8918dfec2e1 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.382641 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.383278 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.383552 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.383820 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] PATH_INFO: `/v3/projects/05c72e5279434669aae119abe832668d` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.384995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c72e5279434669aae119abe832668d)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.387643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.441768 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c72e5279434669aae119abe832668d', 'request_id': 'req-6e1ad228-7937-4a31-b0c0-65a78b1e9103'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:55.448076 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c72e5279434669aae119abe832668d', 'request_id': 'req-6e1ad228-7937-4a31-b0c0-65a78b1e9103'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:55.454380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c72e5279434669aae119abe832668d', 'request_id': 'req-6e1ad228-7937-4a31-b0c0-65a78b1e9103'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:55.468604 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] The token cache is being invalidate because project 05c72e5279434669aae119abe832668d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:41:55.468920 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:55.469580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-6e1ad228-7937-4a31-b0c0-65a78b1e9103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:41:55.471062 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1423/2856] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:41:55 2022] DELETE /identity/v3/projects/05c72e5279434669aae119abe832668d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:41:55.476036 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.476318 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.476591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.525393 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:55.527123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:55.586517 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1434/2857] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:41:55.595014 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.595294 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.595599 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.616747 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:55.617906 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:55.627047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1424/2858] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:55.633152 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.643934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd07f5f-fa4a-4cc8-8f5a-61461cef4a23 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.653609 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.654444 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.654576 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.654896 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.655544 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:41:55.655843 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.657487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.670736 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1435/2859] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:41:55.675375 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.684735 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69620c98-4495-4f30-94c4-7bb8226e1bbb None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.690097 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.690703 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.690973 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.691239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.691861 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.693801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.705536 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:55.723514 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1425/2860] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:41:55 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:41:55.727706 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.738968 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4f0a-88cf-44ec-97ca-584f38a4ee39 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.772409 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:41:55.797875 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.798492 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.798772 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.799043 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.799672 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.801641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.825593 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1436/2861] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:41:55 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:41:55.829992 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.842094 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026419-e3d8-430a-945c-35e46ce1c3f8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.846699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.847301 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.847580 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.847854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.848520 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.850172 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.860999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1426/2862] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:41:55.865277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.876309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8822a5d-8c43-42db-b783-8cdbcfa6db9f admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.881488 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.882120 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.882398 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.882674 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.883319 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.884934 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb0f4d-b9fb-4fea-97c1-4d13f48ca2c7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.896602 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1437/2863] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:41:55.900786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:55.911596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefd7ba-a533-477a-b73a-76240e409136 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:55.916269 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:55.917000 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:55.917304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:55.917574 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] PATH_INFO: `/v3/projects/c492a209dd204f808c6f183375ca0883/users/4d9fb3a9381543b9a38e8edfa6ff580f/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:55.932611 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c492a209dd204f808c6f183375ca0883, user_id=4d9fb3a9381543b9a38e8edfa6ff580f, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:55.935808 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:55.950912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1427/2864] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:41:55 2022] PUT /identity/v3/projects/c492a209dd204f808c6f183375ca0883/users/4d9fb3a9381543b9a38e8edfa6ff580f/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:41:56.017167 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:56.017432 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:56.017703 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:56.046508 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] MFA Rules not processed for user `4d9fb3a9381543b9a38e8edfa6ff580f`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:41:56.047707 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:56.112989 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1438/2865] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:41:56.125312 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:41:56.127013 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:41:56.184721 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5d51e-b043-4df8-9c8c-f7e9e402f80a admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:41:56.188627 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:41:56.189268 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:41:56.189542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:41:56.189812 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:41:56.200154 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:41:56.201617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf49a7-0cc4-4e59-a918-0108c3f906b8 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:41:56.210568 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1428/2866] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:41:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:06.110137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:06.206531 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:09.836966 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:09.900431 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808f559-0bc5-4a17-b0e2-6a1b9b50920b None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:09.904930 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:09.905550 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:09.905830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:09.906089 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] PATH_INFO: `/v3/users/4d9fb3a9381543b9a38e8edfa6ff580f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:09.907291 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d9fb3a9381543b9a38e8edfa6ff580f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:09.909223 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:09.957594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d9fb3a9381543b9a38e8edfa6ff580f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:09.958173 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d9fb3a9381543b9a38e8edfa6ff580f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:09.965301 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d9fb3a9381543b9a38e8edfa6ff580f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:09.965905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d9fb3a9381543b9a38e8edfa6ff580f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:09.972760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d9fb3a9381543b9a38e8edfa6ff580f'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:09.990186 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1439/2867] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:09 2022] DELETE /identity/v3/users/4d9fb3a9381543b9a38e8edfa6ff580f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:09.995047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:09.995578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:09.995578 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.016121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:10.017476 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:10.078265 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1429/2868] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:42:10.088164 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.089561 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:10.148737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f260a-e2d9-4705-a60c-cbd0ccc9f83e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.152420 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.153068 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.153379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.153636 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.164191 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.165676 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7310db-17ce-47d6-8975-e3bd2308c355 service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.175931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1440/2869] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:10.446303 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.447774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:10.459910 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31e3c2-0320-4835-ae7d-c76f803a4034 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.464548 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.465221 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.465500 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.465772 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] PATH_INFO: `/v3/projects/c492a209dd204f808c6f183375ca0883` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.466924 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c492a209dd204f808c6f183375ca0883)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.468912 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.526945 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c492a209dd204f808c6f183375ca0883', 'request_id': 'req-9cabeb80-172f-42fb-8afd-34aa9133b4a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:10.533757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c492a209dd204f808c6f183375ca0883', 'request_id': 'req-9cabeb80-172f-42fb-8afd-34aa9133b4a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:10.539425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c492a209dd204f808c6f183375ca0883', 'request_id': 'req-9cabeb80-172f-42fb-8afd-34aa9133b4a7'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:10.552834 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] The token cache is being invalidate because project c492a209dd204f808c6f183375ca0883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:10.553135 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:10.553757 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-9cabeb80-172f-42fb-8afd-34aa9133b4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:10.555223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1430/2870] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:10 2022] DELETE /identity/v3/projects/c492a209dd204f808c6f183375ca0883 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:10.560309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.560592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.560926 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.581575 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:10.582779 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:10.601004 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:10.648197 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1441/2871] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:10.656233 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.656542 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.657412 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.678285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:10.679505 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:10.688066 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1431/2872] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:10.694002 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.706126 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87832af4-69d3-4ec0-ad72-3d7678e647fc None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.710886 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.711502 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.711781 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.712050 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.712692 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81715) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:42:10.713014 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.714611 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.726524 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1442/2873] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:42:10.731034 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.741122 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2da86-a5f5-4da2-8f83-ea46ed6ed235 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.745875 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.746472 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.746749 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.747018 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.747653 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.749621 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.779632 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1432/2874] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:42:10 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:10.783922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.794110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cc710-d2df-4c48-ae54-0ddf3212cb5c admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.854232 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.854920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.855109 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.855380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.856018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.857964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.879756 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1443/2875] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:42:10 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:10.883926 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.894315 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb812842-f585-44aa-b98d-aec1813f11f7 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.898911 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.899510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.899784 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.900053 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.900689 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.902313 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.913084 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1433/2876] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:42:10.917380 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.928854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcb5e6-4889-4edd-abd3-c84fde04cbb7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.933724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.934375 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.934638 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.934912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.935554 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.937491 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34100a3-b2df-422f-9a41-cfd5fa840f82 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:10.948997 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1444/2877] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:42:10.953496 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:10.963824 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62adcaed-5ac8-4eae-9944-5ae165f2d5ba admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:10.968576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:10.969255 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:10.969565 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:10.969833 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] PATH_INFO: `/v3/projects/7efc7f86ec644a9090704effe2beb4db/users/d5ed059b10d44a7685cb5afaabb6e6c5/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:10.984289 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efc7f86ec644a9090704effe2beb4db, user_id=d5ed059b10d44a7685cb5afaabb6e6c5, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:10.987849 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.002144 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1434/2878] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:42:10 2022] PUT /identity/v3/projects/7efc7f86ec644a9090704effe2beb4db/users/d5ed059b10d44a7685cb5afaabb6e6c5/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:42:11.012354 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.012631 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.012941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.040737 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] MFA Rules not processed for user `d5ed059b10d44a7685cb5afaabb6e6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:11.041912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:11.114365 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1445/2879] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:11.120344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.143481 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:11.190696 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63ee10-a4a9-4c48-9e85-9c328a77a8a8 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.195492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.196101 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.196380 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.196652 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.197326 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.199242 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.227492 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1435/2880] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:11.231649 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.242803 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a0d08-75bb-40f3-84b0-da3bf6ecce95 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.255763 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:11.300912 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.301433 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.301708 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.301979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.302604 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.304505 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.325905 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1446/2881] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:11.330524 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.340841 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520d535-0a66-49b0-9e8b-9f66543d0d03 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.345839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.346445 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.346723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.347059 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.347643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.349304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.360155 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1436/2882] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:42:11.364382 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.374257 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4a9a9-c5ff-4554-810f-9d1e3b3d507e admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.379728 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.380379 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.380656 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.380960 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.381650 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.383286 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a3291-1da1-4fca-acbd-ad6b95fd54e7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.394030 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1447/2883] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:42:11.399069 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.409308 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8710dfb-056c-468c-a029-94ab4f1f5153 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.413939 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.414591 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.414866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.415137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] PATH_INFO: `/v3/projects/aaaeca15a66447a396e88ee587097498/users/97cef1f20cbc43acb4270ae5ff662f5d/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.430051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaaeca15a66447a396e88ee587097498, user_id=97cef1f20cbc43acb4270ae5ff662f5d, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.432724 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.449995 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1437/2884] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:42:11 2022] PUT /identity/v3/projects/aaaeca15a66447a396e88ee587097498/users/97cef1f20cbc43acb4270ae5ff662f5d/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:11.462309 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.462592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.462867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.491740 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] MFA Rules not processed for user `97cef1f20cbc43acb4270ae5ff662f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:11.492991 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:11.558607 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1448/2885] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:11.565244 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.627971 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5506-c961-4682-be49-dd2d85150542 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.632659 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.633327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.633596 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.633866 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.634487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.636394 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.663384 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1438/2886] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:11.667469 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.679155 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82e3b4-729f-4d74-a8ba-3b560cb72ea3 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.736953 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.737567 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.737841 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.738110 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] PATH_INFO: `/v3/users` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.738724 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.740660 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.762293 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1449/2887] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:11.767989 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.780349 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d48b1-83ec-47bc-913b-6d22191c7713 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.785234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.785855 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.786133 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.786407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.787063 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.788685 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.801033 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1439/2888] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:42:11.806497 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.817106 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f2482-2aef-4f0a-ae1e-fef5b5066f33 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.822716 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.823373 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.823645 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.823910 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] PATH_INFO: `/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f/users/c30a3b7b50364d54b0bd8cd4bc736e28/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.836683 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:11.840044 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f44c4088be4d9380d6686e0eb61f1f, user_id=c30a3b7b50364d54b0bd8cd4bc736e28, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.843181 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.857793 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1450/2889] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:42:11 2022] PUT /identity/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f/users/c30a3b7b50364d54b0bd8cd4bc736e28/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:11.862292 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.872337 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccc168-3e76-4f89-9d6c-1f7a8a2b10de admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.914683 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:11.931050 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.931699 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.931977 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.932247 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.932923 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.934519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0e04d-7591-4c2f-85bc-86a924201850 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.945413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1440/2890] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:42:11.949600 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:11.961405 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d0fe-d69e-4a53-9ad7-a02fe237e763 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:11.965952 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:11.966591 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.966871 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.967137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] PATH_INFO: `/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f/users/c30a3b7b50364d54b0bd8cd4bc736e28/roles/8947f3d800e34ad9be6765de1b8613a0` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:11.969055 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f44c4088be4d9380d6686e0eb61f1f, user_id=c30a3b7b50364d54b0bd8cd4bc736e28, role_id=8947f3d800e34ad9be6765de1b8613a0)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:11.972347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:11.982643 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1451/2891] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:42:11 2022] PUT /identity/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f/users/c30a3b7b50364d54b0bd8cd4bc736e28/roles/8947f3d800e34ad9be6765de1b8613a0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:42:11.993831 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:11.994112 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:11.994385 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:12.022256 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] MFA Rules not processed for user `c30a3b7b50364d54b0bd8cd4bc736e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:12.024116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:12.108199 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1441/2892] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:12.121296 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:12.123019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:12.185522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c24e1a-4357-461c-9850-1f62894d9b4b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:12.189720 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:12.190338 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:12.190606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:12.190870 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:12.253019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:12.254537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:12.264245 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1452/2893] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:13.781219 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:13.783257 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:13.795583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d874189-e727-4839-b731-b5a05722ea98 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:13.799815 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:13.800448 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:13.800712 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:13.801023 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:13.863583 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:13.865075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:13.873993 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1442/2894] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:42:14.413521 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:14.422474 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880c0-22e0-47f2-9073-936541ea0dff service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:14.426371 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:14.426979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:14.427254 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:14.427518 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:14.437125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:14.439330 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba5a7b-7f60-4af8-a8f3-35c7337d895d service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:14.448764 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1453/2895] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:18.342319 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:18.406198 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf81700-62f3-45fa-82a1-d13366491d51 service cinder] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:18.411590 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:18.412223 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:18.412501 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:18.412774 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] PATH_INFO: `/v3/users/d5ed059b10d44a7685cb5afaabb6e6c5` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:18.413927 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ed059b10d44a7685cb5afaabb6e6c5)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:18.415860 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:18.421024 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:18.464913 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ed059b10d44a7685cb5afaabb6e6c5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:18.477697 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ed059b10d44a7685cb5afaabb6e6c5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:18.486081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ed059b10d44a7685cb5afaabb6e6c5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:18.486709 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ed059b10d44a7685cb5afaabb6e6c5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:18.487643 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ed059b10d44a7685cb5afaabb6e6c5'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:18.500510 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1443/2896] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:18 2022] DELETE /identity/v3/users/d5ed059b10d44a7685cb5afaabb6e6c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:18.505339 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:18.505866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:18.505866 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:18.525487 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:18.526592 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:18.585370 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1454/2897] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:18.595982 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:18.597425 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:18.656561 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69707da9-e4ab-43e0-a6ed-02bf57b58fca admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:18.660318 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:18.660980 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:18.661229 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:18.661517 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:18.670955 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:18.672440 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:18.682011 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1444/2898] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:18.961107 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:18.962726 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:18.976786 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7809a3-27e4-482b-8df6-653c838b8f28 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:18.981496 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:18.982166 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:18.982446 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:18.982722 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] PATH_INFO: `/v3/projects/7efc7f86ec644a9090704effe2beb4db` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:18.983855 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efc7f86ec644a9090704effe2beb4db)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:18.986400 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:19.003884 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:19.036361 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efc7f86ec644a9090704effe2beb4db', 'request_id': 'req-cba1fe16-9463-4b87-ab66-aeb573e9d017'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.043854 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efc7f86ec644a9090704effe2beb4db', 'request_id': 'req-cba1fe16-9463-4b87-ab66-aeb573e9d017'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.050758 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efc7f86ec644a9090704effe2beb4db', 'request_id': 'req-cba1fe16-9463-4b87-ab66-aeb573e9d017'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.061632 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] The token cache is being invalidate because project 7efc7f86ec644a9090704effe2beb4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:19.061920 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.062571 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.064749 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1455/2899] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:18 2022] DELETE /identity/v3/projects/7efc7f86ec644a9090704effe2beb4db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:19.069091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:19.079105 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82caf058-3b47-46ab-abcc-a375753403b7 service neutron] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:19.138341 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:19.138999 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:19.139280 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:19.139585 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] PATH_INFO: `/v3/users/97cef1f20cbc43acb4270ae5ff662f5d` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:19.140759 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=97cef1f20cbc43acb4270ae5ff662f5d)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:19.142854 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:19.173420 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:19.193617 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97cef1f20cbc43acb4270ae5ff662f5d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.205786 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97cef1f20cbc43acb4270ae5ff662f5d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.212765 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97cef1f20cbc43acb4270ae5ff662f5d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.213498 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97cef1f20cbc43acb4270ae5ff662f5d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.214137 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97cef1f20cbc43acb4270ae5ff662f5d'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.228519 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1445/2900] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:19 2022] DELETE /identity/v3/users/97cef1f20cbc43acb4270ae5ff662f5d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:19.515449 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:19.516929 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:19.529909 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1fe16-9463-4b87-ab66-aeb573e9d017 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:19.590701 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:19.591261 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:19.591537 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:19.591809 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] PATH_INFO: `/v3/projects/aaaeca15a66447a396e88ee587097498` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:19.592958 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaaeca15a66447a396e88ee587097498)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:19.595390 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:19.642745 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaaeca15a66447a396e88ee587097498', 'request_id': 'req-3b0c5706-28e8-4592-95e6-f0934567dc7b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.650067 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaaeca15a66447a396e88ee587097498', 'request_id': 'req-3b0c5706-28e8-4592-95e6-f0934567dc7b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.656523 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaaeca15a66447a396e88ee587097498', 'request_id': 'req-3b0c5706-28e8-4592-95e6-f0934567dc7b'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.668606 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] The token cache is being invalidate because project aaaeca15a66447a396e88ee587097498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:19.668922 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.669608 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.671101 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1456/2901] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:19 2022] DELETE /identity/v3/projects/aaaeca15a66447a396e88ee587097498 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:19.676092 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:19.677734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:19.691279 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2c20c-e179-47ed-85cb-ed47d6b1da9b admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:19.749081 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:19.749723 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:19.750001 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:19.750271 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] PATH_INFO: `/v3/users/c30a3b7b50364d54b0bd8cd4bc736e28` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:19.751441 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30a3b7b50364d54b0bd8cd4bc736e28)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:19.753413 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:19.800537 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30a3b7b50364d54b0bd8cd4bc736e28'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.814336 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30a3b7b50364d54b0bd8cd4bc736e28'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.822004 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30a3b7b50364d54b0bd8cd4bc736e28'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.822818 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30a3b7b50364d54b0bd8cd4bc736e28'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.823469 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-57af0a81-a6c7-42bd-9a11-1e572990d5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30a3b7b50364d54b0bd8cd4bc736e28'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:19.837248 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1446/2902] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:19 2022] DELETE /identity/v3/users/c30a3b7b50364d54b0bd8cd4bc736e28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:20.112667 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.114136 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:20.127791 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c5706-28e8-4592-95e6-f0934567dc7b admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.160850 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:20.189863 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.190490 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.190767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.191037 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] PATH_INFO: `/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.192176 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f44c4088be4d9380d6686e0eb61f1f)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.194131 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.241800 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f44c4088be4d9380d6686e0eb61f1f', 'request_id': 'req-3893edd1-7d9f-4d91-a767-2055f34b1d19'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:20.249489 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f44c4088be4d9380d6686e0eb61f1f', 'request_id': 'req-3893edd1-7d9f-4d91-a767-2055f34b1d19'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:20.256760 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f44c4088be4d9380d6686e0eb61f1f', 'request_id': 'req-3893edd1-7d9f-4d91-a767-2055f34b1d19'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:20.268944 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] The token cache is being invalidate because project e1f44c4088be4d9380d6686e0eb61f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81715) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:20.269226 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:20.269890 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-3893edd1-7d9f-4d91-a767-2055f34b1d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:20.271401 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1457/2903] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:20 2022] DELETE /identity/v3/projects/e1f44c4088be4d9380d6686e0eb61f1f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:20.276286 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.276575 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.276890 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.296128 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:20.297378 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:20.317095 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:20.361801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1447/2904] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:20.371163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.371443 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.371709 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.394251 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:20.395506 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:20.404442 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1458/2905] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:20.409046 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.418798 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d5ab4-fd04-4db9-919b-0485ce24f999 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.423626 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.424239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.424511 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.424779 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] PATH_INFO: `/v3/domains` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.425462 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81714) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:42:20.425767 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.427356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.440217 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1448/2906] 10.222.0.69 () {58 vars in 1153 bytes} [Tue Aug 23 22:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:42:20.444698 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.455569 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003a486-3b81-45fd-848d-f54f40d8c44d None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.460283 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.460933 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.461205 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.461472 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.462093 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.464434 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.491954 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1459/2907] 10.222.0.69 () {60 vars in 1153 bytes} [Tue Aug 23 22:42:20 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:20.496177 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.506949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf886c-80ef-48a5-aaa5-c1073e5d3711 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.562388 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.563051 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.563327 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.564185 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] PATH_INFO: `/v3/users` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.564842 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.566751 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.586949 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1449/2908] 10.222.0.69 () {60 vars in 1144 bytes} [Tue Aug 23 22:42:20 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:42:20.591129 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.602123 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1a45-60d8-4d55-8c18-45e9629cf8e7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.606770 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.607387 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.607665 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.607979 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.608771 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.611163 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.625250 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1460/2909] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:42:20.631057 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.643125 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5655a4-d642-4243-9cb8-dd908dd2f277 admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.647858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.648482 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.648760 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.649072 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] PATH_INFO: `/v3/roles` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.649720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.651354 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447640ad-6ae5-42c5-a718-a76a097b354b admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.664055 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1450/2910] 10.222.0.69 () {58 vars in 1122 bytes} [Tue Aug 23 22:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:42:20.668322 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.679075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc891b2-6918-4aed-8661-d52839e83ce7 admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.683699 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.684347 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.684621 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.684924 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] PATH_INFO: `/v3/projects/03f00796e4b7407d88b5405ac1b6dec0/users/451a37c9e02546e59f601f0034a9cf8c/roles/2db6f108db484377bb8284827c2bc59c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.701612 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f00796e4b7407d88b5405ac1b6dec0, user_id=451a37c9e02546e59f601f0034a9cf8c, role_id=2db6f108db484377bb8284827c2bc59c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.704857 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.719499 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1461/2911] 10.222.0.69 () {60 vars in 1483 bytes} [Tue Aug 23 22:42:20 2022] PUT /identity/v3/projects/03f00796e4b7407d88b5405ac1b6dec0/users/451a37c9e02546e59f601f0034a9cf8c/roles/2db6f108db484377bb8284827c2bc59c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:20.730116 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa555-8461-4dc9-9e5e-4bdc00ffba83 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.730648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa555-8461-4dc9-9e5e-4bdc00ffba83 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.730648 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaa555-8461-4dc9-9e5e-4bdc00ffba83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.760427 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-8abaa555-8461-4dc9-9e5e-4bdc00ffba83 None None] MFA Rules not processed for user `451a37c9e02546e59f601f0034a9cf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:20.761669 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-8abaa555-8461-4dc9-9e5e-4bdc00ffba83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:20.832127 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1451/2912] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:20.843964 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:20.846199 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:20.902985 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4861d0-a0a6-4955-9ce6-279423289fcc admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:20.906806 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3675dd6a15f146f69ce8ffd72fff2999', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:20.908111 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:20.908385 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:20.908659 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:20.917194 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:20.918594 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:20.927945 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1462/2913] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:22.295408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:22.295940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:22.295940 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:22.315997 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] MFA Rules not processed for user `451a37c9e02546e59f601f0034a9cf8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:22.317234 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:22.324120 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1452/2914] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:23.077637 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:23.079134 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:23.085752 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:23.156019 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a36ae-c5cb-4068-a3d5-2250ef0a4db4 service cinder] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:23.162563 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:23.163090 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:23.163328 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:23.163577 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:23.165691 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:23.178018 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:23.179601 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf0fbb-f9b5-49e2-a8d0-c281d4d84477 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:23.190530 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1463/2915] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:31.914752 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:31.916655 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:31.932186 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:32.005878 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed09fe5-64d7-48da-b60e-8f2b67ae23dd None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:32.011839 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c21fbe153d904a19be3b27c499c4f88e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:32.012459 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:32.012733 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:32.013031 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:32.014905 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:32.028153 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:32.029769 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:32.041865 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1453/2916] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:33.185277 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=31 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:38.745266 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753703-15d0-437c-a0c1-0388bbfb701f None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:38.745982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753703-15d0-437c-a0c1-0388bbfb701f None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:38.745982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18753703-15d0-437c-a0c1-0388bbfb701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:38.775974 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-18753703-15d0-437c-a0c1-0388bbfb701f None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:38.777221 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-18753703-15d0-437c-a0c1-0388bbfb701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:38.847082 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1464/2917] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:42:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:38.896151 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:38.897762 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:38.967755 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee8ccb-9c23-4c87-8477-ab9421a1d9d9 service nova] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:38.973121 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:38.973729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:38.974008 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:38.974285 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:38.982328 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:38.983917 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:38.993110 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1454/2918] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:42:39.503950 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb6c0-1f24-4130-a738-a3b6b4bd1f19 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:39.504231 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb6c0-1f24-4130-a738-a3b6b4bd1f19 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:39.504535 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fb6c0-1f24-4130-a738-a3b6b4bd1f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:39.527559 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-b06fb6c0-1f24-4130-a738-a3b6b4bd1f19 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:39.528761 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-b06fb6c0-1f24-4130-a738-a3b6b4bd1f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:39.536075 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1465/2919] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:39.548408 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:39.559694 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe841d-bdeb-4439-b44c-8d6e9d48568e service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:39.565832 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:39.566522 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:39.566803 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:39.567073 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:39.575284 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:39.576967 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:39.585399 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1455/2920] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:42:39.804011 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5fe6-24dd-49af-a890-48545bc5fae2 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:39.804556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5fe6-24dd-49af-a890-48545bc5fae2 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:39.804556 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e5fe6-24dd-49af-a890-48545bc5fae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:39.826125 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-e26e5fe6-24dd-49af-a890-48545bc5fae2 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:39.827435 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-e26e5fe6-24dd-49af-a890-48545bc5fae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:39.836641 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1466/2921] 10.222.0.69 () {58 vars in 1009 bytes} [Tue Aug 23 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:39.848316 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:39.858830 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba42f2f-9f7e-4b10-bee4-7d37c0e7dc19 service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:39.864109 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:39.864717 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:39.865032 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:39.865304 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:39.873635 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:39.875239 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:39.883858 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1456/2922] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:42:40.221941 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] REQUEST_METHOD: `POST` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:40.222228 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:40.222507 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:40.241616 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.auth.core [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] MFA Rules not processed for user `61a775a6854049d7b75a54aab8d448a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81715) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:40.242830 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:40.250179 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1467/2923] 10.222.0.69 () {58 vars in 967 bytes} [Tue Aug 23 22:42:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:40.262197 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:40.273622 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79482f5-e74b-4697-8be4-69bf4c4cc07c service swift] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:40.279360 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '783f430a59254acfbb4a7af3bb69b472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:40.279968 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:40.280252 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:40.280526 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:40.289667 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:40.291258 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0da21-0af4-4ecf-846a-f1ade3b44197 service swift] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:40.299485 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1457/2924] 10.222.0.69 () {60 vars in 1384 bytes} [Tue Aug 23 22:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:42:42.436352 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:42.501274 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1b3dd-2bca-4ab3-9031-696c27541c40 None None] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:42.506585 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:42.507215 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:42.507494 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:42.507767 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] PATH_INFO: `/v3/users/451a37c9e02546e59f601f0034a9cf8c` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:42.508931 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=451a37c9e02546e59f601f0034a9cf8c)` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:42.510867 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:42.558178 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451a37c9e02546e59f601f0034a9cf8c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:42.558836 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451a37c9e02546e59f601f0034a9cf8c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:42.567408 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451a37c9e02546e59f601f0034a9cf8c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:42.568027 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451a37c9e02546e59f601f0034a9cf8c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:42.575013 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.notifications [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451a37c9e02546e59f601f0034a9cf8c'} {{(pid=81715) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:42.586117 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:42.594183 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1468/2925] 10.222.0.69 () {58 vars in 1224 bytes} [Tue Aug 23 22:42:42 2022] DELETE /identity/v3/users/451a37c9e02546e59f601f0034a9cf8c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:42.599487 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] REQUEST_METHOD: `POST` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:42.600040 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:42.600166 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:42.619941 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.auth.core [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] MFA Rules not processed for user `ac0d80e10ea2452cb1a6dfc9b7ea1191`. Rule list: `[]` (Enabled: `True`). {{(pid=81714) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:42:42.621356 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:42.659576 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=100 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:42:42.682330 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1458/2926] 10.222.0.69 () {58 vars in 958 bytes} [Tue Aug 23 22:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:42:42.692455 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:42.693897 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:42.753419 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2830-2084-4192-8f05-a7139baa36bd admin admin] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:42.757070 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee0b9bc7e5fa4b0d9f67ea235dae32a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:42.757679 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:42.757975 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:42.758224 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:42.767775 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:42.769388 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:42.778996 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1469/2927] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:42.953734 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:42.955720 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:42.967943 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7832a-a75a-4f85-acf0-83fb192d7780 None None] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:42.973872 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac0d80e10ea2452cb1a6dfc9b7ea1191', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c27876b25e104fc48bd2eb1b5131a55c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:42.974791 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:42.975075 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:42.975344 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] PATH_INFO: `/v3/projects/03f00796e4b7407d88b5405ac1b6dec0` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:42.976582 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f00796e4b7407d88b5405ac1b6dec0)` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:42.979054 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:43.029047 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f00796e4b7407d88b5405ac1b6dec0', 'request_id': 'req-60109b43-5a71-4824-a5dc-6081f1c10bfc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:43.036091 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f00796e4b7407d88b5405ac1b6dec0', 'request_id': 'req-60109b43-5a71-4824-a5dc-6081f1c10bfc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:43.041931 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f00796e4b7407d88b5405ac1b6dec0', 'request_id': 'req-60109b43-5a71-4824-a5dc-6081f1c10bfc'} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:43.055332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] The token cache is being invalidate because project 03f00796e4b7407d88b5405ac1b6dec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81714) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:42:43.055332 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:43.055922 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.notifications [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81714) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:42:43.057646 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1459/2928] 10.222.0.69 () {58 vars in 1233 bytes} [Tue Aug 23 22:42:42 2022] DELETE /identity/v3/projects/03f00796e4b7407d88b5405ac1b6dec0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:42:50.175990 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] Authenticating user token {{(pid=81715) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:42:50.177417 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:50.268509 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be1d56-c8dd-4175-bf9b-01ad04716fdc service neutron] Validating token access rules against request {{(pid=81715) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:42:50.338441 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81715) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:42:50.338982 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] REQUEST_METHOD: `GET` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:42:50.339256 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] SCRIPT_NAME: `/identity` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:42:50.339522 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81715) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:42:50.341300 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.fernet_utils [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81715) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:42:50.354174 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:42:50.355769 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec47b6-868c-4624-bdb5-4b68bbfc3306 service placement] RBAC: Authorization granted {{(pid=81715) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:42:50.366599 dv-cinder-842542-4-smb devstack@keystone.service[81715]: [pid: 81715|app: 0|req: 1470/2929] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:42:53.051674 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG dbcounter [-] [81714] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81714) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:43:00.362137 dv-cinder-842542-4-smb devstack@keystone.service[81715]: DEBUG dbcounter [-] [81715] Writing DB stats keystone:SELECT=95 {{(pid=81715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:47:55.201729 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Authenticating user token {{(pid=81714) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:47:55.203212 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.fernet_utils [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81714) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:47:55.217785 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109b43-5a71-4824-a5dc-6081f1c10bfc admin admin] Validating token access rules against request {{(pid=81714) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:47:55.223246 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be96e2c5285540cca2ecc4e73a75cd0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23b22943e2514c8e9505656dd923fb15', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81714) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:47:55.223843 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] REQUEST_METHOD: `GET` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:47:55.224123 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] SCRIPT_NAME: `/identity` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:47:55.224407 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81714) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:47:55.232801 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:47:55.235149 dv-cinder-842542-4-smb devstack@keystone.service[81714]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca631b11-f733-4d9e-b3de-2e02ed472fae service placement] RBAC: Authorization granted {{(pid=81714) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:47:55.245179 dv-cinder-842542-4-smb devstack@keystone.service[81714]: [pid: 81714|app: 0|req: 1460/2930] 10.222.0.69 () {60 vars in 1365 bytes} [Tue Aug 23 22:47:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)